Sep 17 23:33:16 devstack cinder-volume[74941]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 23:33:16 devstack cinder-volume[74941]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 23:33:16 devstack cinder-volume[74941]: we strongly recommend against using it for new projects. Sep 17 23:33:16 devstack cinder-volume[74941]: If you are already using Eventlet, we recommend migrating to a different Sep 17 23:33:16 devstack cinder-volume[74941]: framework. For more detail see Sep 17 23:33:16 devstack cinder-volume[74941]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 23:33:16 devstack cinder-volume[74941]: import eventlet # noqa Sep 17 23:33:18 devstack cinder-volume[74941]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 23:33:18 devstack cinder-volume[74941]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 23:33:18 devstack cinder-volume[74941]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 23:33:19 devstack cinder-volume[74941]: INFO dbcounter [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Registered counter for database cinder Sep 17 23:33:20 devstack cinder-volume[74941]: DEBUG oslo_db.sqlalchemy.engines [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:33:20 devstack cinder-volume[74941]: DEBUG dbcounter [-] [74941] Writer thread running {{(pid=74941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 23:33:20 devstack cinder-volume[74941]: INFO cinder.rpc [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 23:33:20 devstack cinder-volume[74941]: INFO cinder.rpc [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 23:33:20 devstack cinder-volume[74941]: DEBUG oslo_db.sqlalchemy.engines [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:33:20 devstack cinder-volume[74941]: INFO cinder.volume.manager [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Determined volume DB was empty at startup. Sep 17 23:33:20 devstack cinder-volume[74941]: DEBUG cinder.volume.manager [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74941) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 23:33:20 devstack cinder-volume[74941]: INFO cinder.volume.manager [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 23:33:20 devstack cinder-volume[74941]: WARNING stevedore.named [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 23:33:20 devstack cinder-volume[74941]: WARNING castellan.key_manager [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 23:33:20 devstack cinder-volume[74941]: WARNING cinder.keymgr.conf_key_mgr [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 23:33:20 devstack cinder-volume[74941]: DEBUG cinder.volume.drivers.lvm [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74941) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 17 23:33:20 devstack cinder-volume[74941]: DEBUG oslo_concurrency.processutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:20 devstack cinder-volume[74941]: DEBUG oslo_concurrency.processutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.461s {{(pid=74941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_db.sqlalchemy.engines [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:33:21 devstack cinder-volume[74941]: INFO cinder.rpc [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 23:33:21 devstack cinder-volume[74941]: INFO cinder.rpc [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 23:33:21 devstack cinder-volume[74941]: WARNING stevedore.named [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 23:33:21 devstack cinder-volume[74941]: WARNING castellan.key_manager [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 23:33:21 devstack cinder-volume[74941]: INFO cinder.volume.manager [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_db.sqlalchemy.engines [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:33:21 devstack cinder-volume[74941]: INFO oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Starting 1 workers Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Started child 75089 {{(pid=74941) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Full set of CONF: {{(pid=74941) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] ******************************************************************************** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Configuration options gathered from: {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] ================================================================================ {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 23:33:21 devstack cinder-volume[75089]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] allow_availability_zone_fallback = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] allow_compression_on_image_upload = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] allowed_direct_url_schemes = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] api_rate_limit = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] auth_strategy = keystone {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] az_cache_duration = 3600 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_availability_zone = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_host = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_stats_polling_interval = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backup_api_class = cinder.backup.api.API {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backup_name_template = backup-%s {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backup_use_same_host = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backup_use_temp_snapshot = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] chap_password = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] chap_username = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_internal_tenant_project_id = b5960e332a7d48d0afa72ea01ea8d9a3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_internal_tenant_user_id = 584bb734cda34cd2810e77a60ae1fac8 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cloned_volume_same_az = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cluster = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] compression_format = gzip {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] compute_api_class = cinder.compute.nova.API {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] config_dir = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] config_source = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] control_exchange = openstack {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] debug = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] default_availability_zone = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] default_group_type = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] default_volume_type = lvmdriver-1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] disk_geometry = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] driver_client_cert = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] driver_client_cert_key = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] driver_data_namespace = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] driver_ssl_cert_path = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] driver_ssl_cert_verify = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] driver_use_ssl = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] enable_force_upload = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] enable_new_services = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] enable_unsupported_driver = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] enforce_multipath_for_image_xfer = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] filter_function = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_api_insecure = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_api_ssl_compression = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_ca_certificates_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[75089]: INFO cinder.volume.manager [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_catalog_info = image:glance:publicURL {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_num_retries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance_request_timeout = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] goodness_function = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] graceful_shutdown_timeout = 5 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] group_api_class = cinder.group.api.API {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] host = devstack {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_compress_on_upload = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_conversion_address_space_limit = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_conversion_cpu_limit = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_conversion_disable = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_introspection_address_space_limit = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_introspection_cpu_limit = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_upload_use_cinder_backend = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_upload_use_internal_tenant = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_volume_cache_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_volume_cache_max_count = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] init_host_max_objects_retrieval = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] instance_format = [instance: %(uuid)s] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] iscsi_target_flags = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] iscsi_write_cache = on {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] iser_helper = tgtadm {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] iser_ip_address = 192.168.122.67 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] iser_port = 3260 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_color = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_config_append = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_dir = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_options = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_rotate_interval = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_rotate_interval_type = days {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] log_rotation_type = none {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] max_age = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] max_logfile_count = 30 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] max_logfile_size_mb = 200 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] max_over_subscription_ratio = 20.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] message_reap_interval = 86400 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] message_ttl = 2592000 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] monkey_patch = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] monkey_patch_modules = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] my_ip = 192.168.122.67 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] no_snapshot_gb_quota = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] num_iser_scan_tries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] num_shell_tries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] num_volume_device_scan_tries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] nvmeof_conn_info_version = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] nvmet_ns_id = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] nvmet_port_id = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] osapi_max_limit = 1000 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] osapi_volume_ext_list = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] osapi_volume_listen_port = 8776 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] osapi_volume_use_ssl = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] osapi_volume_workers = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] per_volume_size_limit = -1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] periodic_fuzzy_delay = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] periodic_interval = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] public_endpoint = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] publish_errors = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] quota_backup_gigabytes = 1000 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] quota_backups = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] quota_gigabytes = 1000 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] quota_groups = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] quota_snapshots = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] quota_volumes = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] rate_limit_burst = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] rate_limit_except_level = CRITICAL {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] rate_limit_interval = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] reinit_driver_count = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] replication_device = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] report_discard_supported = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] report_interval = 120 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] reservation_clean_interval = 86400 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] reservation_expire = 86400 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] reserved_image_namespaces = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] reserved_percentage = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] rpc_response_timeout = 120 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] run_external_periodic_tasks = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] scst_target_driver = iscsi {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] scst_target_iqn_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_down_time = 720 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] shell_completion = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] snapshot_name_template = snapshot-%s {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] snapshot_same_host = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] split_loggers = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] state_path = /opt/stack/data/cinder {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] storage_availability_zone = nova {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] storage_protocol = iSCSI {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] syslog_log_facility = LOG_USER {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] target_helper = lioadm {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] target_ip_address = 192.168.122.67 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] target_port = 3260 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] target_protocol = iscsi {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] target_secondary_ip_addresses = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] trace_flags = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] transport_url = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] until_refresh = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] use_chap_auth = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] use_default_quota_class = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] use_journal = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] use_json = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] use_multipath_for_image_xfer = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] use_stderr = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] use_syslog = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] verify_glance_signatures = enabled {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_api_class = cinder.volume.api.API {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_backend_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_clear = zero {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_clear_ionice = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_clear_size = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_copy_bps_limit = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_dd_blocksize = 1M {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_name_template = volume-%s {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_service_inithost_offload = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volume_usage_audit_period = month {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] zoning_mode = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.auth_section = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.auth_type = password {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.auth_version = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.cache = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.insecure = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.interface = public {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_password = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcache_username = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.region_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.service_type = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.backend = dogpile.cache.null {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.backend_argument = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.backend_expiration_time = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.config_prefix = cache.oslo {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.debug_cache_backend = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.enable_retry_client = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.enable_socket_keepalive = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.expiration_time = 600 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.memcache_dead_retry = 300 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.memcache_pool_maxsize = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.memcache_sasl_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.password = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.proxies = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.redis_db = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.redis_server = localhost:6379 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.retry_attempts = 2 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.retry_delay = 0.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.socket_keepalive_count = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.socket_keepalive_idle = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.socket_keepalive_interval = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.socket_timeout = 1.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.tls_allowed_ciphers = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.tls_cafile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.tls_certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.tls_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.tls_keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cache.username = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] coordination.backend_url = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.asyncio_connection = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.asyncio_slave_connection = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.backend = sqlalchemy {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.connection = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.connection_debug = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.connection_parameters = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.connection_recycle_time = 3600 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.connection_trace = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.db_inc_retry_interval = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.db_max_retries = 20 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.db_max_retry_interval = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.db_retry_interval = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.max_overflow = 50 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.max_pool_size = 5 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.max_retries = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.pool_timeout = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.retry_interval = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.slave_connection = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.sqlite_synchronous = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.synchronous_reader = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] database.use_db_reconnect = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_tracing.insecure = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.connection_string = messaging:// {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.es_doc_type = notification {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.es_scroll_size = 10000 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.es_scroll_time = 2m {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.filter_error_trace = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.hmac_keys = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.sentinel_service_name = mymaster {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.socket_timeout = 0.1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.trace_requests = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler.trace_sqlalchemy = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler_jaeger.process_tags = {} {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] profiler_otlp.service_name_prefix = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.enforce_new_defaults = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.policy_default_rule = default {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.policy_file = policy.yaml {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] privsep_osbrick.group = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] privsep_osbrick.helper_command = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] privsep_osbrick.user = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_sys_admin.group = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_sys_admin.helper_command = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack sudo[75096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] cinder_sys_admin.user = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.auth_section = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.auth_type = password {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.cafile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack sudo[75096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.collect_timing = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.insecure = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.send_service_user_token = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.split_loggers = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.timeout = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.tls_ciphers = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] service_user.tls_min_version = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.auth_section = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.auth_type = password {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.collect_timing = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.insecure = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.region_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.split_loggers = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.timeout = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.tls_ciphers = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] glance.tls_min_version = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.backend_availability_zone = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.chap_password = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.chap_username = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.disk_geometry = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.driver_client_cert = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.driver_data_namespace = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.driver_use_ssl = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.extra_capabilities = {} {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.filter_function = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.goodness_function = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.iscsi_target_flags = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.iser_helper = tgtadm {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.iser_port = 3260 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.lvm_share_target = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.lvm_type = auto {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.replication_device = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.report_discard_supported = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.target_helper = tgtadm {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.target_port = 3260 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.target_protocol = iscsi {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.trace_flags = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.use_chap_auth = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_backend_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_clear = zero {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_reports.file_event_handler = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_reports.log_dir = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.backend_host = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.chap_password = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.chap_username = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.disk_geometry = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.driver_client_cert = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.extra_capabilities = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.filter_function = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.goodness_function = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.iser_helper = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.iser_ip_address = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.iser_port = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.lvm_share_target = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.lvm_type = auto {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.num_shell_tries = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.replication_device = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.report_discard_supported = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.reserved_percentage = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.scst_target_driver = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.storage_protocol = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.target_helper = lioadm {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.target_ip_address = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.target_port = 3260 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.trace_flags = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.use_chap_auth = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_clear = zero {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_clear_size = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] lvmdriver-1.volumes_dir = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.ssl = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_notifications.driver = [] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] key_manager.fixed_key = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.barbican_api_version = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.barbican_endpoint = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.barbican_endpoint_type = public {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.barbican_region_name = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.cafile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.collect_timing = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.insecure = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.number_of_retries = 60 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.retry_delay = 1 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.send_service_user_token = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.split_loggers = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.timeout = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.tls_ciphers = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.tls_min_version = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.verify_ssl = True {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican.verify_ssl_path = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.auth_section = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.auth_type = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.cafile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.certfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.collect_timing = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.insecure = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.keyfile = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.split_loggers = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.timeout = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.tls_ciphers = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] barbican_service_user.tls_min_version = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.approle_role_id = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.approle_secret_id = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.auth_method = approle {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.auth_path = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.kv_mountpoint = secret {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.kv_path = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.kv_version = 2 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.namespace = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.root_token_id = **** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.ssl_ca_crt_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.timeout = 60.0 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.token_file = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.token_role = None {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.use_ssl = False {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:33:21 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] ******************************************************************************** {{(pid=74941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 23:33:21 devstack sudo[75096]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:21 devstack sudo[75100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:21 devstack sudo[75100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:21 devstack sudo[75100]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.274s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:33:21 devstack cinder-volume[75089]: INFO cinder.brick.local_dev.lvm [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:21 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:21 devstack sudo[75107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:33:21 devstack sudo[75107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:22 devstack sudo[75107]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:22 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:22 devstack cinder-volume[75089]: DEBUG cinder.brick.local_dev.lvm [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75089) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 17 23:33:22 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:22 devstack sudo[75231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:22 devstack sudo[75231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:22 devstack sudo[75231]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:22 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:22 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:22 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:22 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:22 devstack sudo[75433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:22 devstack sudo[75433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:23 devstack sudo[75433]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:23 devstack sudo[75545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 23:33:23 devstack sudo[75545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:23 devstack sudo[75545]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.268s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:23 devstack sudo[75629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:33:23 devstack sudo[75629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:23 devstack sudo[75629]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:23 devstack sudo[75707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:33:23 devstack sudo[75707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:23 devstack sudo[75707]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:23 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:23 devstack sudo[75715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:33:23 devstack sudo[75715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:24 devstack sudo[75715]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:24 devstack sudo[75793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:24 devstack sudo[75793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:24 devstack sudo[75793]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:24 devstack sudo[75803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:24 devstack sudo[75803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:24 devstack sudo[75803]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:24 devstack cinder-volume[75089]: INFO cinder.volume.drivers.lvm [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:24 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:24 devstack sudo[75888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:24 devstack sudo[75888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:25 devstack sudo[75888]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG cinder.volume.drivers.lvm [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Updating volume stats {{(pid=75089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:25 devstack sudo[75891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:33:25 devstack sudo[75891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:25 devstack sudo[75891]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:25 devstack sudo[75900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:33:25 devstack sudo[75900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:25 devstack sudo[75900]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:25 devstack sudo[75903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:25 devstack sudo[75903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:25 devstack sudo[75903]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:25 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:25 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:33:25 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:26 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:26 devstack cinder-volume[75089]: INFO cinder.volume.driver [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Driver hasn't implemented _init_vendor_properties() Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG cinder.volume.driver [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75089) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG oslo_db.sqlalchemy.engines [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75089) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG dbcounter [-] [75089] Writer thread running {{(pid=75089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG cinder.db.api [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Building query based on filter {{(pid=75089) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG cinder.image.image_utils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75089) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 23:33:26 devstack cinder-volume[75089]: INFO cinder.keymgr.migration [None req-8c300987-61bf-4000-9b18-ea8b17d12da0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG cinder.volume.drivers.lvm [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Updating volume stats {{(pid=75089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:26 devstack sudo[75911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:33:26 devstack sudo[75911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:26 devstack sudo[75911]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:26 devstack sudo[75914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:33:26 devstack sudo[75914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:26 devstack sudo[75914]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:26 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:26 devstack sudo[75918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:26 devstack sudo[75918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:27 devstack sudo[75918]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:27 devstack sudo[75922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:33:27 devstack sudo[75922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:27 devstack sudo[75922]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG cinder.manager [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Notifying Schedulers of capabilities ... {{(pid=75089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:33:27 devstack cinder-volume[75089]: INFO cinder.volume.manager [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Driver initialization completed successfully. Sep 17 23:33:27 devstack cinder-volume[75089]: INFO cinder.manager [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Initiating service 2 cleanup Sep 17 23:33:27 devstack cinder-volume[75089]: INFO cinder.manager [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Service 2 cleanup completed. Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG cinder.service [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Creating RPC server for service cinder-volume {{(pid=75089) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG cinder.service [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75089) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 23:33:27 devstack cinder-volume[75089]: INFO cinder.volume.manager [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG cinder.volume.drivers.lvm [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Updating volume stats {{(pid=75089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:27 devstack sudo[75925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:33:27 devstack sudo[75925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:27 devstack sudo[75925]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:27 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:27 devstack sudo[75928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:33:27 devstack sudo[75928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:28 devstack sudo[75928]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:28 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:28 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:28 devstack sudo[75932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:33:28 devstack sudo[75932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:28 devstack sudo[75932]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:28 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:28 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:33:28 devstack sudo[75936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:33:28 devstack sudo[75936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:33:28 devstack sudo[75936]: pam_unix(sudo:session): session closed for user root Sep 17 23:33:28 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:33:28 devstack cinder-volume[75089]: INFO cinder.volume.manager [None req-a1863209-9058-41d8-9a99-9c73631e24cc None None] Driver post RPC initialization completed successfully. Sep 17 23:33:31 devstack cinder-volume[74941]: DEBUG dbcounter [-] [74941] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:33:37 devstack cinder-volume[75089]: DEBUG dbcounter [-] [75089] Writing DB stats cinder:SELECT=3 {{(pid=75089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:33:38 devstack cinder-volume[75089]: DEBUG dbcounter [-] [75089] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:33:59 devstack cinder-volume[75089]: DEBUG oslo_service.periodic_task [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running periodic task VolumeManager._thread_info {{(pid=75089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:33:59 devstack cinder-volume[75089]: DEBUG cinder.volume.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] thread count: 6 {{(pid=75089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:33:59 devstack cinder-volume[75089]: DEBUG cinder.volume.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] thread info: [<_MainThread(MainThread, started 125734971011200)>, , , , , ] {{(pid=75089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:34:59 devstack cinder-volume[75089]: DEBUG oslo_service.periodic_task [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:34:59 devstack cinder-volume[75089]: DEBUG cinder.volume.drivers.lvm [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Updating volume stats {{(pid=75089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 23:34:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:34:59 devstack sudo[78828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:34:59 devstack sudo[78828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:34:59 devstack sudo[78828]: pam_unix(sudo:session): session closed for user root Sep 17 23:34:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:34:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:34:59 devstack sudo[79004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:34:59 devstack sudo[79004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:35:00 devstack sudo[79004]: pam_unix(sudo:session): session closed for user root Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:35:00 devstack sudo[79192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:35:00 devstack sudo[79192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:35:00 devstack sudo[79192]: pam_unix(sudo:session): session closed for user root Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:35:00 devstack sudo[79373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:35:00 devstack sudo[79373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:35:00 devstack sudo[79373]: pam_unix(sudo:session): session closed for user root Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG cinder.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Notifying Schedulers of capabilities ... {{(pid=75089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG oslo_service.periodic_task [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running periodic task VolumeManager._thread_info {{(pid=75089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG cinder.volume.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] thread count: 6 {{(pid=75089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:35:00 devstack cinder-volume[75089]: DEBUG cinder.volume.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] thread info: [<_MainThread(MainThread, started 125734971011200)>, , , , , ] {{(pid=75089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:35:38 devstack cinder-volume[75089]: DEBUG dbcounter [-] [75089] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:35:59 devstack cinder-volume[75089]: DEBUG oslo_service.periodic_task [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:35:59 devstack cinder-volume[75089]: DEBUG cinder.volume.drivers.lvm [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Updating volume stats {{(pid=75089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 23:35:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:35:59 devstack sudo[82466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:35:59 devstack sudo[82466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:35:59 devstack sudo[82466]: pam_unix(sudo:session): session closed for user root Sep 17 23:35:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:35:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:35:59 devstack sudo[82486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:35:59 devstack sudo[82486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:36:00 devstack sudo[82486]: pam_unix(sudo:session): session closed for user root Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:36:00 devstack sudo[82504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:36:00 devstack sudo[82504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:36:00 devstack sudo[82504]: pam_unix(sudo:session): session closed for user root Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:36:00 devstack sudo[82519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:36:00 devstack sudo[82519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:36:00 devstack sudo[82519]: pam_unix(sudo:session): session closed for user root Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG cinder.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Notifying Schedulers of capabilities ... {{(pid=75089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG oslo_service.periodic_task [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running periodic task VolumeManager._thread_info {{(pid=75089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG cinder.volume.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] thread count: 6 {{(pid=75089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:36:00 devstack cinder-volume[75089]: DEBUG cinder.volume.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] thread info: [<_MainThread(MainThread, started 125734971011200)>, , , , , ] {{(pid=75089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:36:59 devstack cinder-volume[75089]: DEBUG oslo_service.periodic_task [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:36:59 devstack cinder-volume[75089]: DEBUG cinder.volume.drivers.lvm [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Updating volume stats {{(pid=75089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 23:36:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:36:59 devstack sudo[84019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 23:36:59 devstack sudo[84019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:36:59 devstack sudo[84019]: pam_unix(sudo:session): session closed for user root Sep 17 23:36:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:36:59 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:36:59 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:36:59 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:37:00 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Sep 17 23:37:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:37:00 devstack sudo[84025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 23:37:00 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:37:00 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root Sep 17 23:37:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:37:00 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 23:37:00 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:37:00 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Sep 17 23:37:00 devstack cinder-volume[75089]: DEBUG oslo_concurrency.processutils [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:00 devstack cinder-volume[75089]: DEBUG cinder.manager [None req-c3f0ec15-ec1e-4782-b653-0a01332de9a1 None None] Notifying Schedulers of capabilities ... {{(pid=75089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:37:38 devstack cinder-volume[75089]: DEBUG dbcounter [-] [75089] Writing DB stats cinder:SELECT=1 {{(pid=75089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:37:38 devstack cinder-volume[75089]: DEBUG dbcounter [-] [75089] Writing DB stats cinder:UPDATE=1 {{(pid=75089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:37:52 devstack cinder-volume[74941]: INFO oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Caught SIGTERM, stopping children Sep 17 23:37:52 devstack cinder-volume[74941]: DEBUG oslo_concurrency.lockutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Acquiring lock "singleton_lock" {{(pid=74941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 23:37:52 devstack cinder-volume[74941]: DEBUG oslo_concurrency.lockutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Acquired lock "singleton_lock" {{(pid=74941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 23:37:52 devstack cinder-volume[74941]: DEBUG oslo_concurrency.lockutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Releasing lock "singleton_lock" {{(pid=74941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 23:37:52 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Stop services. {{(pid=74941) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 23:37:52 devstack cinder-volume[74941]: DEBUG oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Killing children. {{(pid=74941) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 23:37:52 devstack cinder-volume[74941]: INFO oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Waiting on 1 children to exit Sep 17 23:37:52 devstack cinder-volume[75089]: DEBUG oslo_concurrency.lockutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Acquiring lock "singleton_lock" {{(pid=75089) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 23:37:52 devstack cinder-volume[75089]: DEBUG oslo_concurrency.lockutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Acquired lock "singleton_lock" {{(pid=75089) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 23:37:52 devstack cinder-volume[75089]: DEBUG oslo_concurrency.lockutils [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Releasing lock "singleton_lock" {{(pid=75089) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 23:37:52 devstack cinder-volume[75089]: WARNING amqp [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 23:37:52 devstack cinder-volume[75089]: WARNING amqp [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 23:37:52 devstack cinder-volume[74941]: INFO oslo_service.backend._eventlet.service [None req-0d1832c6-4c40-4052-9f99-1a48699560f8 None None] Child 75089 exited with status 0 Sep 17 23:37:52 devstack cinder-volume[85104]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 23:37:52 devstack cinder-volume[85104]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 23:37:52 devstack cinder-volume[85104]: we strongly recommend against using it for new projects. Sep 17 23:37:52 devstack cinder-volume[85104]: If you are already using Eventlet, we recommend migrating to a different Sep 17 23:37:52 devstack cinder-volume[85104]: framework. For more detail see Sep 17 23:37:52 devstack cinder-volume[85104]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 23:37:52 devstack cinder-volume[85104]: import eventlet # noqa Sep 17 23:37:54 devstack cinder-volume[85104]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85104) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 23:37:54 devstack cinder-volume[85104]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85104) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 23:37:54 devstack cinder-volume[85104]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85104) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 23:37:55 devstack cinder-volume[85104]: INFO dbcounter [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Registered counter for database cinder Sep 17 23:37:55 devstack cinder-volume[85104]: DEBUG oslo_db.sqlalchemy.engines [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85104) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG dbcounter [-] [85104] Writer thread running {{(pid=85104) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 23:37:56 devstack cinder-volume[85104]: INFO cinder.rpc [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 23:37:56 devstack cinder-volume[85104]: INFO cinder.rpc [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_db.sqlalchemy.engines [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85104) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:37:56 devstack cinder-volume[85104]: INFO cinder.volume.manager [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Determined volume DB was empty at startup. Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG cinder.volume.manager [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85104) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 23:37:56 devstack cinder-volume[85104]: INFO cinder.volume.manager [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 23:37:56 devstack cinder-volume[85104]: WARNING stevedore.named [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 23:37:56 devstack cinder-volume[85104]: WARNING castellan.key_manager [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 23:37:56 devstack cinder-volume[85104]: WARNING cinder.keymgr.conf_key_mgr [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 23:37:56 devstack cinder-volume[85104]: INFO cinder.volume.manager [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_db.sqlalchemy.engines [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85104) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:37:56 devstack cinder-volume[85104]: INFO oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Starting 1 workers Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Started child 85318 {{(pid=85104) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Full set of CONF: {{(pid=85104) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] ******************************************************************************** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Configuration options gathered from: {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] ================================================================================ {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] allow_availability_zone_fallback = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] allow_compression_on_image_upload = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] allowed_direct_url_schemes = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] api_rate_limit = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] auth_strategy = keystone {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_availability_zone = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_host = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_stats_polling_interval = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backup_api_class = cinder.backup.api.API {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85318]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backup_name_template = backup-%s {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backup_use_same_host = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backup_use_temp_snapshot = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] chap_password = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] chap_username = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_internal_tenant_project_id = b5960e332a7d48d0afa72ea01ea8d9a3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_internal_tenant_user_id = 584bb734cda34cd2810e77a60ae1fac8 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cluster = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] compression_format = gzip {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] compute_api_class = cinder.compute.nova.API {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] config_dir = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] config_source = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] control_exchange = openstack {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] debug = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] default_availability_zone = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] default_group_type = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] default_volume_type = QuobyteHD {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] disk_geometry = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] driver_client_cert = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] driver_client_cert_key = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] driver_data_namespace = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] driver_ssl_cert_path = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] driver_ssl_cert_verify = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] driver_use_ssl = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] enable_new_services = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] enable_unsupported_driver = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] enabled_backends = ['QuobyteHD'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] enforce_multipath_for_image_xfer = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] filter_function = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_api_insecure = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_api_ssl_compression = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_ca_certificates_file = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_catalog_info = image:glance:publicURL {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_num_retries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance_request_timeout = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] goodness_function = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] graceful_shutdown_timeout = 5 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] group_api_class = cinder.group.api.API {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] host = devstack {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_compress_on_upload = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_conversion_address_space_limit = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_conversion_cpu_limit = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_conversion_disable = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_introspection_address_space_limit = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_introspection_cpu_limit = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_upload_use_cinder_backend = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_upload_use_internal_tenant = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_volume_cache_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_volume_cache_max_count = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] image_volume_cache_max_size_gb = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] init_host_max_objects_retrieval = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] instance_format = [instance: %(uuid)s] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] iscsi_target_flags = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] iscsi_write_cache = on {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] iser_helper = tgtadm {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] iser_ip_address = 192.168.122.67 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] iser_port = 3260 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_color = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_config_append = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_dir = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_file = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_options = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_rotate_interval = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_rotate_interval_type = days {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] log_rotation_type = none {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] max_age = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] max_logfile_count = 30 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] max_logfile_size_mb = 200 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] max_over_subscription_ratio = 20.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] message_reap_interval = 86400 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] message_ttl = 2592000 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] migration_create_volume_timeout_secs = 300 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] monkey_patch = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] monkey_patch_modules = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] my_ip = 192.168.122.67 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] no_snapshot_gb_quota = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] num_iser_scan_tries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] num_shell_tries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] num_volume_device_scan_tries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] nvmeof_conn_info_version = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] nvmet_ns_id = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] nvmet_port_id = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] osapi_max_limit = 1000 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] osapi_volume_ext_list = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] osapi_volume_listen = 0.0.0.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] osapi_volume_listen_port = 8776 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] osapi_volume_use_ssl = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] osapi_volume_workers = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] per_volume_size_limit = -1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] periodic_fuzzy_delay = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] periodic_interval = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] project_id_regex = [0-9a-f\-]+ {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] public_endpoint = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] publish_errors = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] quota_backup_gigabytes = 1000 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] quota_backups = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] quota_gigabytes = 1000 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] quota_groups = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] quota_snapshots = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] quota_volumes = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] rate_limit_burst = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] rate_limit_except_level = CRITICAL {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] rate_limit_interval = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] reinit_driver_count = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] replication_device = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] report_discard_supported = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] report_interval = 120 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] reservation_clean_interval = 86400 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] reservation_expire = 86400 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] reserved_image_namespaces = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] reserved_percentage = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] rpc_response_timeout = 120 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] run_external_periodic_tasks = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] scst_target_driver = iscsi {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] scst_target_iqn_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_down_time = 720 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] shell_completion = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] snapshot_name_template = snapshot-%s {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] split_loggers = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] state_path = /opt/stack/data/cinder {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] storage_availability_zone = nova {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] storage_protocol = iSCSI {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] syslog_log_facility = LOG_USER {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] target_helper = lioadm {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] target_ip_address = 192.168.122.67 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] target_port = 3260 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85318]: INFO cinder.volume.manager [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] target_protocol = iscsi {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.remotefs [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85318) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] target_secondary_ip_addresses = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] trace_flags = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] transfer_api_class = cinder.transfer.api.API {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] transport_url = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] until_refresh = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] use_chap_auth = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] use_default_quota_class = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] use_journal = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] use_json = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] use_multipath_for_image_xfer = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] use_stderr = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] use_syslog = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] verify_glance_signatures = enabled {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_api_class = cinder.volume.api.API {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_backend_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_clear = zero {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_clear_ionice = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_clear_size = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_copy_bps_limit = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_dd_blocksize = 1M {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_name_template = volume-%s {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_service_inithost_offload = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volume_usage_audit_period = month {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] zoning_mode = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_concurrency.disable_process_locking = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.auth_section = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.auth_type = password {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.auth_version = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.cache = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.include_service_catalog = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.insecure = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.interface = public {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_password = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcache_username = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.region_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.service_type = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.backend = dogpile.cache.null {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.backend_argument = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.backend_expiration_time = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.config_prefix = cache.oslo {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.debug_cache_backend = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.enable_retry_client = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.enable_socket_keepalive = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.expiration_time = 600 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.hashclient_retry_attempts = 2 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.memcache_dead_retry = 300 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.memcache_pool_maxsize = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.memcache_sasl_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.password = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.proxies = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.redis_db = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.redis_server = localhost:6379 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.retry_attempts = 2 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.retry_delay = 0.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.socket_keepalive_count = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.socket_keepalive_idle = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.socket_keepalive_interval = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.socket_timeout = 1.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.tls_allowed_ciphers = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.tls_cafile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.tls_certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.tls_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.tls_keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cache.username = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] coordination.backend_url = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.asyncio_connection = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.asyncio_slave_connection = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.backend = sqlalchemy {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.connection = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.connection_debug = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.connection_parameters = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.connection_recycle_time = 3600 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.connection_trace = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.db_inc_retry_interval = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.db_max_retries = 20 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.db_max_retry_interval = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.db_retry_interval = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.max_overflow = 50 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.max_pool_size = 5 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.max_retries = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.mysql_wsrep_sync_wait = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.pool_timeout = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.retry_interval = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.slave_connection = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.sqlite_synchronous = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.synchronous_reader = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] database.use_db_reconnect = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_tracing.insecure = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.connection_string = messaging:// {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.es_doc_type = notification {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.es_scroll_size = 10000 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.es_scroll_time = 2m {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.filter_error_trace = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.hmac_keys = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.sentinel_service_name = mymaster {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.socket_timeout = 0.1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.trace_requests = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler.trace_sqlalchemy = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler_jaeger.process_tags = {} {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler_jaeger.service_name_prefix = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] profiler_otlp.service_name_prefix = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.enforce_new_defaults = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.policy_default_rule = default {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.policy_file = policy.yaml {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_policy.remote_timeout = 60.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] privsep_osbrick.group = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] privsep_osbrick.helper_command = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] privsep_osbrick.user = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_sys_admin.group = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_sys_admin.helper_command = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] cinder_sys_admin.user = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.auth_section = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.auth_type = password {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.cafile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.collect_timing = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.insecure = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.send_service_user_token = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.split_loggers = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.timeout = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.tls_ciphers = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] service_user.tls_min_version = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.auth_section = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.auth_type = password {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.collect_timing = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.insecure = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.region_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.split_loggers = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.timeout = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.tls_ciphers = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] glance.tls_min_version = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.backend_availability_zone = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.chap_password = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.chap_username = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.disk_geometry = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.driver_client_cert = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.driver_client_cert_key = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.driver_data_namespace = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.driver_use_ssl = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.extra_capabilities = {} {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.filter_function = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.goodness_function = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.iscsi_target_flags = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.iscsi_write_cache = on {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.iser_helper = tgtadm {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.iser_port = 3260 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_host = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_login = admin {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_mount_options = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_password = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_private_key = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_share_path = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_ssh_port = 22 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.num_shell_tries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.quobyte_client_cfg = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.quobyte_volume_url = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.replication_device = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.report_discard_supported = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.reserved_percentage = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.target_helper = tgtadm {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.target_port = 3260 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85318) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 23:37:56 devstack cinder-volume[85318]: WARNING cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.target_protocol = iscsi {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.trace_flags = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85318]: WARNING cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.unique_fqdn_network = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.use_chap_auth = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_backend_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_clear = zero {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_clear_ionice = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_clear_size = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Running cmd (subprocess): mount.quobyte {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_reports.file_event_handler = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_reports.log_dir = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.backend_availability_zone = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.backend_host = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.chap_password = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.chap_username = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.chiscsi_conf = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.disk_geometry = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.driver_client_cert = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.driver_client_cert_key = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.driver_data_namespace = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.driver_use_ssl = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.extra_capabilities = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.filter_function = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.goodness_function = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.iscsi_target_flags = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.iscsi_write_cache = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.iser_helper = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.iser_ip_address = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.iser_port = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.iser_target_prefix = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_host = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_login = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_mount_options = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_password = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_private_key = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_share_path = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_ssh_port = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.num_shell_tries = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nvmet_ns_id = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.nvmet_port_id = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.replication_device = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.report_discard_supported = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.reserved_percentage = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.scst_target_driver = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.storage_protocol = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.target_helper = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.target_ip_address = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.target_port = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.target_prefix = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.target_protocol = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.trace_flags = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.unique_fqdn_network = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.use_chap_auth = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_clear = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_clear_ionice = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_clear_size = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] QuobyteHD.volumes_dir = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.ssl = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.ssl_version = {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_notifications.driver = [] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_notifications.retry = -1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] key_manager.fixed_key = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.barbican_api_version = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.barbican_endpoint = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.barbican_endpoint_type = public {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.barbican_region_name = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.cafile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.collect_timing = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.insecure = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.number_of_retries = 60 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.retry_delay = 1 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.send_service_user_token = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.split_loggers = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.timeout = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.tls_ciphers = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.tls_min_version = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.verify_ssl = True {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican.verify_ssl_path = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.auth_section = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.auth_type = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.cafile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.certfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.collect_timing = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.insecure = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.keyfile = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.split_loggers = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.timeout = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.tls_ciphers = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] barbican_service_user.tls_min_version = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.approle_role_id = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.approle_secret_id = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.auth_method = approle {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.auth_path = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.kv_mountpoint = secret {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.kv_path = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.kv_version = 2 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.namespace = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.root_token_id = **** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.ssl_ca_crt_file = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.timeout = 60.0 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.token_file = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.token_role = None {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.use_ssl = False {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:37:56 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] ******************************************************************************** {{(pid=85104) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 23:37:56 devstack quobyte-client[85321]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 23:37:56 devstack quobyte-client[85321]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85318) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:37:56 devstack cinder-volume[85318]: INFO cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 ... Sep 17 23:37:56 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 -c /etc/quobyte/client-cinder.cfg {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:37:56 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 -c /etc/quobyte/client-cinder.cfg Sep 17 23:37:56 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:37:57 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.395s {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:57 devstack cinder-volume[85318]: INFO cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 succeeded Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85318) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.408s {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:37:57 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:37:57 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:37:57 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.270s {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:57 devstack cinder-volume[85318]: INFO cinder.volume.driver [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.volume.driver [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.771152496338, 'free_capacity_gb': 1775.771152496338, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85318) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_db.sqlalchemy.engines [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG dbcounter [-] [85318] Writer thread running {{(pid=85318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.db.api [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Building query based on filter {{(pid=85318) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.image.image_utils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85318) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 23:37:57 devstack cinder-volume[85318]: INFO cinder.keymgr.migration [None req-e0d5eaf3-58ad-4949-9c5a-4f4dfa1d5212 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85318) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85318) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:37:57 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:37:57 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:37:57 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.239s {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.manager [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Notifying Schedulers of capabilities ... {{(pid=85318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:37:57 devstack cinder-volume[85318]: INFO cinder.volume.manager [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Driver initialization completed successfully. Sep 17 23:37:57 devstack cinder-volume[85318]: INFO cinder.manager [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Initiating service 3 cleanup Sep 17 23:37:57 devstack cinder-volume[85318]: INFO cinder.manager [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Service 3 cleanup completed. Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.service [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Creating RPC server for service cinder-volume {{(pid=85318) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.service [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85318) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 23:37:57 devstack cinder-volume[85318]: INFO cinder.volume.manager [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85318) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG cinder.volume.drivers.quobyte [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85318) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85318) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:37:57 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:37:57 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:37:57 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:37:58 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Sep 17 23:37:58 devstack cinder-volume[85318]: DEBUG oslo_concurrency.processutils [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.276s {{(pid=85318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:37:58 devstack cinder-volume[85318]: INFO cinder.volume.manager [None req-59eba66b-692c-4f53-85d8-0a32eb17a779 None None] Driver post RPC initialization completed successfully. Sep 17 23:37:59 devstack cinder-volume[85318]: DEBUG oslo_service.periodic_task [None req-bb6a5893-18bf-46e5-a7b0-c0a55bc36e30 None None] Running periodic task VolumeManager._thread_info {{(pid=85318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:37:59 devstack cinder-volume[85318]: DEBUG cinder.volume.manager [None req-bb6a5893-18bf-46e5-a7b0-c0a55bc36e30 None None] thread count: 6 {{(pid=85318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:37:59 devstack cinder-volume[85318]: DEBUG cinder.volume.manager [None req-bb6a5893-18bf-46e5-a7b0-c0a55bc36e30 None None] thread info: [<_MainThread(MainThread, started 135356336361600)>, , , , , ] {{(pid=85318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:38:02 devstack cinder-volume[85104]: INFO oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Caught SIGTERM, stopping children Sep 17 23:38:02 devstack cinder-volume[85104]: DEBUG oslo_concurrency.lockutils [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Acquiring lock "singleton_lock" {{(pid=85104) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 23:38:02 devstack cinder-volume[85104]: DEBUG oslo_concurrency.lockutils [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Acquired lock "singleton_lock" {{(pid=85104) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 23:38:02 devstack cinder-volume[85104]: DEBUG oslo_concurrency.lockutils [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Releasing lock "singleton_lock" {{(pid=85104) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 23:38:02 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Stop services. {{(pid=85104) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 23:38:02 devstack cinder-volume[85104]: DEBUG oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Killing children. {{(pid=85104) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 23:38:02 devstack cinder-volume[85104]: INFO oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Waiting on 1 children to exit Sep 17 23:38:06 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Acquiring lock "singleton_lock" {{(pid=85318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 23:38:06 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Acquired lock "singleton_lock" {{(pid=85318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 23:38:06 devstack cinder-volume[85318]: DEBUG oslo_concurrency.lockutils [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Releasing lock "singleton_lock" {{(pid=85318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 23:38:06 devstack cinder-volume[85318]: WARNING amqp [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 23:38:06 devstack cinder-volume[85318]: WARNING amqp [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 23:38:06 devstack cinder-volume[85104]: INFO oslo_service.backend._eventlet.service [None req-e5989543-ad92-46aa-9448-937d114ac4fd None None] Child 85318 exited with status 0 Sep 17 23:38:07 devstack cinder-volume[85642]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 23:38:07 devstack cinder-volume[85642]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 23:38:07 devstack cinder-volume[85642]: we strongly recommend against using it for new projects. Sep 17 23:38:07 devstack cinder-volume[85642]: If you are already using Eventlet, we recommend migrating to a different Sep 17 23:38:07 devstack cinder-volume[85642]: framework. For more detail see Sep 17 23:38:07 devstack cinder-volume[85642]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 23:38:07 devstack cinder-volume[85642]: import eventlet # noqa Sep 17 23:38:09 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 23:38:09 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 23:38:09 devstack cinder-volume[85642]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85642) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 23:38:10 devstack cinder-volume[85642]: INFO dbcounter [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Registered counter for database cinder Sep 17 23:38:10 devstack cinder-volume[85642]: DEBUG oslo_db.sqlalchemy.engines [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:38:10 devstack cinder-volume[85642]: DEBUG dbcounter [-] [85642] Writer thread running {{(pid=85642) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 23:38:10 devstack cinder-volume[85642]: INFO cinder.rpc [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 23:38:10 devstack cinder-volume[85642]: INFO cinder.rpc [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 23:38:10 devstack cinder-volume[85642]: DEBUG oslo_db.sqlalchemy.engines [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:38:10 devstack cinder-volume[85642]: INFO cinder.volume.manager [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Determined volume DB was empty at startup. Sep 17 23:38:10 devstack cinder-volume[85642]: DEBUG cinder.volume.manager [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85642) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 23:38:10 devstack cinder-volume[85642]: WARNING stevedore.named [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 23:38:10 devstack cinder-volume[85642]: WARNING castellan.key_manager [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 23:38:10 devstack cinder-volume[85642]: WARNING cinder.keymgr.conf_key_mgr [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 23:38:10 devstack cinder-volume[85642]: INFO cinder.volume.manager [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 23:38:10 devstack cinder-volume[85642]: DEBUG oslo_db.sqlalchemy.engines [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:38:11 devstack cinder-volume[85642]: INFO oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Starting 1 workers Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Started child 85956 {{(pid=85642) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Full set of CONF: {{(pid=85642) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] ******************************************************************************** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] Configuration options gathered from: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] ================================================================================ {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] allow_availability_zone_fallback = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] allow_compression_on_image_upload = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] allowed_direct_url_schemes = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] api_rate_limit = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] auth_strategy = keystone {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_host = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_stats_polling_interval = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backup_api_class = cinder.backup.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backup_name_template = backup-%s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backup_use_same_host = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backup_use_temp_snapshot = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] chap_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] chap_username = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_internal_tenant_project_id = b5960e332a7d48d0afa72ea01ea8d9a3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_internal_tenant_user_id = 584bb734cda34cd2810e77a60ae1fac8 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cluster = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] compression_format = gzip {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] compute_api_class = cinder.compute.nova.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] config_dir = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] config_source = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] control_exchange = openstack {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] debug = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] default_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] default_group_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] default_volume_type = QuobyteHD {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] disk_geometry = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] driver_client_cert = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] driver_client_cert_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] driver_data_namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] driver_ssl_cert_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] driver_ssl_cert_verify = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] driver_use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] enable_new_services = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] enable_unsupported_driver = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] enabled_backends = ['QuobyteHD'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] enforce_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] filter_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_api_insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_api_ssl_compression = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_ca_certificates_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_catalog_info = image:glance:publicURL {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_num_retries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance_request_timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] goodness_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] graceful_shutdown_timeout = 5 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] group_api_class = cinder.group.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] host = devstack {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_compress_on_upload = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_conversion_address_space_limit = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_conversion_cpu_limit = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_conversion_disable = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_introspection_address_space_limit = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_introspection_cpu_limit = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_upload_use_cinder_backend = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_upload_use_internal_tenant = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_volume_cache_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_volume_cache_max_count = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] image_volume_cache_max_size_gb = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] init_host_max_objects_retrieval = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] instance_format = [instance: %(uuid)s] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85956) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] iscsi_target_flags = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] iscsi_write_cache = on {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] iser_helper = tgtadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] iser_ip_address = 192.168.122.67 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] iser_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_color = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_config_append = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_dir = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_options = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_rotate_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_rotate_interval_type = days {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] log_rotation_type = none {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] max_age = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] max_logfile_count = 30 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] max_logfile_size_mb = 200 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] max_over_subscription_ratio = 20.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] message_reap_interval = 86400 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] message_ttl = 2592000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] migration_create_volume_timeout_secs = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] monkey_patch = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] monkey_patch_modules = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] my_ip = 192.168.122.67 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] no_snapshot_gb_quota = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] num_iser_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] num_shell_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] num_volume_device_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] nvmeof_conn_info_version = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] nvmet_ns_id = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] nvmet_port_id = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] osapi_max_limit = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] osapi_volume_ext_list = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] osapi_volume_listen = 0.0.0.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] osapi_volume_listen_port = 8776 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] osapi_volume_use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] osapi_volume_workers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] per_volume_size_limit = -1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] periodic_fuzzy_delay = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] periodic_interval = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] project_id_regex = [0-9a-f\-]+ {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] public_endpoint = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] publish_errors = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] quota_backup_gigabytes = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] quota_backups = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] quota_gigabytes = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] quota_groups = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] quota_snapshots = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] quota_volumes = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] rate_limit_burst = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] rate_limit_except_level = CRITICAL {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] rate_limit_interval = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] reinit_driver_count = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] replication_device = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] report_discard_supported = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] report_interval = 120 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] reservation_clean_interval = 86400 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] reservation_expire = 86400 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] reserved_image_namespaces = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] reserved_percentage = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] rpc_response_timeout = 120 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] run_external_periodic_tasks = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] scst_target_driver = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] scst_target_iqn_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_down_time = 720 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] shell_completion = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] snapshot_name_template = snapshot-%s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] state_path = /opt/stack/data/cinder {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] storage_availability_zone = nova {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] storage_protocol = iSCSI {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] syslog_log_facility = LOG_USER {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] target_helper = lioadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] target_ip_address = 192.168.122.67 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] target_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] target_protocol = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] target_secondary_ip_addresses = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] trace_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] transfer_api_class = cinder.transfer.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] transport_url = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] until_refresh = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] use_chap_auth = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] use_default_quota_class = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] use_journal = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] use_json = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] use_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] use_stderr = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] use_syslog = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] verify_glance_signatures = enabled {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_api_class = cinder.volume.api.API {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_backend_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_clear = zero {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_clear_ionice = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_clear_size = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_copy_bps_limit = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_dd_blocksize = 1M {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_name_template = volume-%s {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_service_inithost_offload = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volume_usage_audit_period = month {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] zoning_mode = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_concurrency.disable_process_locking = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.auth_type = password {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.auth_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.cache = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.delay_auth_decision = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.http_connect_timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.include_service_catalog = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.interface = public {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85956) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 23:38:11 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 23:38:11 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Running cmd (subprocess): mount.quobyte {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcache_username = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.region_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.service_token_roles_required = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.service_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.token_cache_time = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.backend = dogpile.cache.null {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.backend_argument = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.backend_expiration_time = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.config_prefix = cache.oslo {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.debug_cache_backend = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.enable_retry_client = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.enable_socket_keepalive = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.expiration_time = 600 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.hashclient_retry_attempts = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.memcache_dead_retry = 300 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.memcache_pool_maxsize = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.memcache_sasl_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.proxies = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.redis_db = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.redis_sentinel_service_name = mymaster {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.redis_server = localhost:6379 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.retry_attempts = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.retry_delay = 0.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.socket_keepalive_count = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.socket_keepalive_idle = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.socket_keepalive_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.socket_timeout = 1.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.tls_allowed_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.tls_cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.tls_certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.tls_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.tls_keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cache.username = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] coordination.backend_url = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.asyncio_connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.asyncio_slave_connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.backend = sqlalchemy {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.connection_debug = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.connection_parameters = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.connection_recycle_time = 3600 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.connection_trace = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.db_inc_retry_interval = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.db_max_retries = 20 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.db_max_retry_interval = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.db_retry_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.max_overflow = 50 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.max_pool_size = 5 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.max_retries = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.mysql_wsrep_sync_wait = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.pool_timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.retry_interval = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.slave_connection = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.sqlite_synchronous = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.synchronous_reader = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] database.use_db_reconnect = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_tracing.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.connection_string = messaging:// {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.es_doc_type = notification {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.es_scroll_size = 10000 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.es_scroll_time = 2m {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.filter_error_trace = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.hmac_keys = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.sentinel_service_name = mymaster {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.socket_timeout = 0.1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.trace_requests = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler.trace_sqlalchemy = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler_jaeger.process_tags = {} {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler_jaeger.service_name_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] profiler_otlp.service_name_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.enforce_new_defaults = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.policy_default_rule = default {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.policy_file = policy.yaml {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_policy.remote_timeout = 60.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] privsep_osbrick.group = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] privsep_osbrick.helper_command = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] privsep_osbrick.user = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_sys_admin.group = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_sys_admin.helper_command = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] cinder_sys_admin.user = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.auth_type = password {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.send_service_user_token = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack quobyte-client[85957]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.tls_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] service_user.tls_min_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack quobyte-client[85957]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.auth_type = password {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.region_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.tls_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] glance.tls_min_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.backend_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.chap_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.chap_username = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.disk_geometry = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.driver_client_cert = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.driver_client_cert_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.driver_data_namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.driver_use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.enable_unsupported_driver = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.extra_capabilities = {} {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.filter_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.goodness_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.iscsi_target_flags = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.iscsi_write_cache = on {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.iser_helper = tgtadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.iser_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_host = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_login = admin {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_mount_options = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_private_key = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_share_path = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_ssh_port = 22 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.num_shell_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.nvmet_port_id = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.quobyte_client_cfg = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.quobyte_volume_url = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.replication_device = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.report_discard_supported = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.reserved_percentage = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.scst_target_driver = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.scst_target_iqn_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.storage_protocol = iSCSI {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.target_helper = tgtadm {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.target_port = 3260 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.target_protocol = iscsi {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.trace_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.unique_fqdn_network = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.use_chap_auth = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_backend_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_clear = zero {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_clear_ionice = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_clear_size = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_reports.file_event_handler = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_reports.log_dir = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.backend_availability_zone = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.backend_host = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.chap_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.chap_username = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.chiscsi_conf = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.disk_geometry = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.driver_client_cert = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.driver_client_cert_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.driver_data_namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.driver_use_ssl = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.extra_capabilities = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.filter_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.goodness_function = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.iscsi_target_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.iscsi_write_cache = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.iser_helper = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.iser_ip_address = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.iser_port = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.iser_target_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_host = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_login = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_mount_options = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_password = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_private_key = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_share_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_ssh_port = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.num_shell_tries = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nvmet_ns_id = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.nvmet_port_id = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.replication_device = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.report_discard_supported = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.reserved_percentage = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.scst_target_driver = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.storage_protocol = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.target_helper = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.target_ip_address = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.target_port = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.target_prefix = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.target_protocol = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.trace_flags = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.unique_fqdn_network = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.use_chap_auth = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_clear = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_clear_ionice = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_clear_size = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] QuobyteHD.volumes_dir = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.ssl_version = {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_notifications.driver = [] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_notifications.retry = -1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] oslo_messaging_notifications.transport_url = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] key_manager.fixed_key = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.barbican_api_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.barbican_endpoint = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.barbican_endpoint_type = public {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.barbican_region_name = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.number_of_retries = 60 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.retry_delay = 1 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.send_service_user_token = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.tls_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.tls_min_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.verify_ssl = True {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican.verify_ssl_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.auth_section = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.auth_type = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.cafile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.certfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.collect_timing = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.insecure = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.keyfile = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.split_loggers = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.timeout = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.tls_ciphers = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] barbican_service_user.tls_min_version = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.approle_role_id = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.approle_secret_id = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.auth_method = approle {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.auth_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.kv_mountpoint = secret {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.kv_path = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.kv_version = 2 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.namespace = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.root_token_id = **** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.ssl_ca_crt_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.timeout = 60.0 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.token_file = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.token_role = None {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.use_ssl = False {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 23:38:11 devstack cinder-volume[85642]: DEBUG oslo_service.backend._eventlet.service [None req-327faec0-dc7c-481e-9bd5-fe3111cb11dc None None] ******************************************************************************** {{(pid=85642) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 23:38:11 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.254s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.volume.driver [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.driver [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.770751953125, 'free_capacity_gb': 1775.770751953125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85956) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_db.sqlalchemy.engines [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85956) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writer thread running {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.db.api [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Building query based on filter {{(pid=85956) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85956) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.keymgr.migration [None req-3665fbdf-290c-4640-9890-4006885dc74e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 23:38:11 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:38:11 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:38:11 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.231s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Driver initialization completed successfully. Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.manager [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Initiating service 3 cleanup Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.manager [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Service 3 cleanup completed. Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.service [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Creating RPC server for service cinder-volume {{(pid=85956) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.service [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85956) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 23:38:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:38:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:38:11 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:38:11 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:38:12 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Sep 17 23:38:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.248s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:38:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4f50660b-f066-4537-a7bc-7dd022436be3 None None] Driver post RPC initialization completed successfully. Sep 17 23:38:21 devstack cinder-volume[85642]: DEBUG dbcounter [-] [85642] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85642) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:38:21 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:38:22 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=3 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:38:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:38:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 6 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:38:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Flow 'volume_create_manager' (5e4d9b85-7441-4463-bed2-72d2bf73bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50864b8-784a-4083-a377-d95f4ffac68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Flow 'volume_create_manager' (6115cf28-01f4-4161-9747-8a839d165fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e55d231-bf8b-458f-87ee-50e69b1745e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e55d231-bf8b-458f-87ee-50e69b1745e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-961630977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8503c11c-6ae8-45a2-8565-c004864f5eeb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ecfff9b29545a09e00c4afb797310f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:08Z,use_quota=True,user_id='53ec73c6293e4dd687148a9010958cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc407547-34bb-49a9-83fe-a7bd09b85993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc407547-34bb-49a9-83fe-a7bd09b85993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16570171-af20-45d1-a0fd-047b2a69edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16570171-af20-45d1-a0fd-047b2a69edf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8503c11c-6ae8-45a2-8565-c004864f5eeb', 'volume_name': 'volume-8503c11c-6ae8-45a2-8565-c004864f5eeb', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d60ef30-9369-48a2-9553-eebf6566d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d60ef30-9369-48a2-9553-eebf6566d879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e702db7-3c68-4f4a-bba1-1eaf0e6925f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Volume 8503c11c-6ae8-45a2-8565-c004864f5eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8503c11c-6ae8-45a2-8565-c004864f5eeb', 'volume_size': 1} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-961630977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8503c11c-6ae8-45a2-8565-c004864f5eeb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ecfff9b29545a09e00c4afb797310f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:08Z,use_quota=True,user_id='53ec73c6293e4dd687148a9010958cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Creating volume 8503c11c-6ae8-45a2-8565-c004864f5eeb {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:39:08 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50864b8-784a-4083-a377-d95f4ffac68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-427228711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8b4ffa-3246-4f5d-8325-30e486d59d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80cf1b2edd04de28178a53a975109a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:08Z,use_quota=True,user_id='3d04986803d44b1d9bb1a53b213a592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb 1073741824 Sep 17 23:39:08 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4211aeb2-184d-4177-aefb-14520850537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4211aeb2-184d-4177-aefb-14520850537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8b976-ffe3-4a1a-875e-9a571fb7a2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8b976-ffe3-4a1a-875e-9a571fb7a2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8b4ffa-3246-4f5d-8325-30e486d59d5c', 'volume_name': 'volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cb92ce-0efb-47b2-813e-4f31a54c31d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cb92ce-0efb-47b2-813e-4f31a54c31d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1294c536-24d8-48f9-8b68-b983990ce953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:08 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Volume 8e8b4ffa-3246-4f5d-8325-30e486d59d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c', 'volume_size': 1} Sep 17 23:39:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:09 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb 1073741824" returned: 0 in 0.741s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:09 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb Sep 17 23:39:09 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:09 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb" returned: 0 in 0.352s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-427228711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8b4ffa-3246-4f5d-8325-30e486d59d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80cf1b2edd04de28178a53a975109a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:08Z,use_quota=True,user_id='3d04986803d44b1d9bb1a53b213a592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Creating volume 8e8b4ffa-3246-4f5d-8325-30e486d59d5c {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:39:09 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:09 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c 1073741824 Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e702db7-3c68-4f4a-bba1-1eaf0e6925f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8503c11c-6ae8-45a2-8565-c004864f5eeb', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:09 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e768d22-250e-4eb3-88a9-143fb97ecf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:09 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Volume volume-8503c11c-6ae8-45a2-8565-c004864f5eeb (8503c11c-6ae8-45a2-8565-c004864f5eeb): created successfully Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e768d22-250e-4eb3-88a9-143fb97ecf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Flow 'volume_create_manager' (6115cf28-01f4-4161-9747-8a839d165fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:09 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-485800b8-d460-4548-8d87-0d1997810351 tempest-VolumesTestJSON-739060516 None] Created volume successfully. Sep 17 23:39:10 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c 1073741824" returned: 0 in 0.801s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:10 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c Sep 17 23:39:10 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:10 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c" returned: 0 in 0.429s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1294c536-24d8-48f9-8b68-b983990ce953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cf38de-63a1-470c-9dce-cef3d2787866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Volume volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c (8e8b4ffa-3246-4f5d-8325-30e486d59d5c): created successfully Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cf38de-63a1-470c-9dce-cef3d2787866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Flow 'volume_create_manager' (5e4d9b85-7441-4463-bed2-72d2bf73bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8545db53-36b8-4375-a7ad-2f5029415233 tempest-TaggedAttachmentsTest-1130789379 None] Created volume successfully. Sep 17 23:39:10 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Flow 'volume_create_manager' (d8894775-005a-447e-aafd-2b56f86a4924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1710e-1bbb-4ee9-8a14-a2e162721481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1710e-1bbb-4ee9-8a14-a2e162721481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-594964082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f15880-4da1-4be7-b32d-a3737d332907,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ecfff9b29545a09e00c4afb797310f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:11Z,use_quota=True,user_id='53ec73c6293e4dd687148a9010958cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a3246a-43b6-4bf3-8804-a5e612773957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a3246a-43b6-4bf3-8804-a5e612773957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68e6aa1-ea5e-46d7-8368-d7a59910e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68e6aa1-ea5e-46d7-8368-d7a59910e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f15880-4da1-4be7-b32d-a3737d332907', 'volume_name': 'volume-f5f15880-4da1-4be7-b32d-a3737d332907', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e2e02-7ff0-434d-a419-151c9c01cd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e2e02-7ff0-434d-a419-151c9c01cd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec03f9ad-23fd-456a-bfe7-d5d72863106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Volume f5f15880-4da1-4be7-b32d-a3737d332907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f15880-4da1-4be7-b32d-a3737d332907', 'volume_size': 1} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-594964082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f15880-4da1-4be7-b32d-a3737d332907,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ecfff9b29545a09e00c4afb797310f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:11Z,use_quota=True,user_id='53ec73c6293e4dd687148a9010958cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Creating volume f5f15880-4da1-4be7-b32d-a3737d332907 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:39:11 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:11 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 1073741824 Sep 17 23:39:11 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:11 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 1073741824" returned: 0 in 0.692s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:11 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 Sep 17 23:39:11 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:12 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907" returned: 0 in 0.424s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:39:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec03f9ad-23fd-456a-bfe7-d5d72863106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f15880-4da1-4be7-b32d-a3737d332907', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8e6123-2bfe-4164-8e88-29be12cd4f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:12 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Volume volume-f5f15880-4da1-4be7-b32d-a3737d332907 (f5f15880-4da1-4be7-b32d-a3737d332907): created successfully Sep 17 23:39:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8e6123-2bfe-4164-8e88-29be12cd4f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Flow 'volume_create_manager' (d8894775-005a-447e-aafd-2b56f86a4924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ddadecf3-8444-484a-be98-4628e00ec2a4 tempest-VolumesTestJSON-739060516 None] Created volume successfully. Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Flow 'volume_create_manager' (edb61e3c-8fbc-40b9-81d7-8ae7293e116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1521e6-f320-403c-a0a6-9d26e105e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1521e6-f320-403c-a0a6-9d26e105e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-201028904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710fca2c-877a-4814-b884-62fb1d108409,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ecfff9b29545a09e00c4afb797310f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:14Z,use_quota=True,user_id='53ec73c6293e4dd687148a9010958cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faef6aca-ac38-4e64-941b-7edb301d8515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faef6aca-ac38-4e64-941b-7edb301d8515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287a374f-82e2-4177-8b24-a640397e3f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287a374f-82e2-4177-8b24-a640397e3f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710fca2c-877a-4814-b884-62fb1d108409', 'volume_name': 'volume-710fca2c-877a-4814-b884-62fb1d108409', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027fab9f-7e23-4ee6-8966-299e3f0027bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027fab9f-7e23-4ee6-8966-299e3f0027bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf5c4b2-3f68-44a4-8d45-3976fa0482fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Volume 710fca2c-877a-4814-b884-62fb1d108409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710fca2c-877a-4814-b884-62fb1d108409', 'volume_size': 1} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-201028904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710fca2c-877a-4814-b884-62fb1d108409,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ecfff9b29545a09e00c4afb797310f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:14Z,use_quota=True,user_id='53ec73c6293e4dd687148a9010958cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Creating volume 710fca2c-877a-4814-b884-62fb1d108409 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:39:13 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:39:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:13 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 1073741824 Sep 17 23:39:14 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:14 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 1073741824" returned: 0 in 0.552s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:14 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 Sep 17 23:39:14 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:14 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409" returned: 0 in 0.277s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf5c4b2-3f68-44a4-8d45-3976fa0482fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710fca2c-877a-4814-b884-62fb1d108409', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ef36e3-5e82-48c7-a62b-1667cc0af188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:14 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Volume volume-710fca2c-877a-4814-b884-62fb1d108409 (710fca2c-877a-4814-b884-62fb1d108409): created successfully Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ef36e3-5e82-48c7-a62b-1667cc0af188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Flow 'volume_create_manager' (edb61e3c-8fbc-40b9-81d7-8ae7293e116d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-96033ff5-3041-4027-8478-24bd6a7a606e tempest-VolumesTestJSON-739060516 None] Created volume successfully. Sep 17 23:39:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Acquiring lock "cinder-710fca2c-877a-4814-b884-62fb1d108409-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Lock "cinder-710fca2c-877a-4814-b884-62fb1d108409-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Acquiring lock "cinder-quobyte-710fca2c-877a-4814-b884-62fb1d108409" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Lock "cinder-quobyte-710fca2c-877a-4814-b884-62fb1d108409" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:17 devstack cinder-volume[85956]: INFO oslo.privsep.daemon [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdc5rq9h3/privsep.sock'] Sep 17 23:39:17 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdc5rq9h3/privsep.sock Sep 17 23:39:17 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 23:39:18 devstack cinder-volume[85956]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 17 23:39:18 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:18 devstack cinder-volume[85956]: INFO oslo.privsep.daemon [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Spawned new privsep daemon via rootwrap Sep 17 23:39:18 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Accepted privsep connection to /tmp/tmpdc5rq9h3/privsep.sock {{(pid=85956) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 17 23:39:18 devstack cinder-volume[85956]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 23:39:18 devstack cinder-volume[85956]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 23:39:18 devstack cinder-volume[85956]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 23:39:18 devstack cinder-volume[85956]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86697 Sep 17 23:39:18 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf6b575-cced-4c13-8c9d-8b86204442fc]: (2,) {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:39:18 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3d9ea-4bdf-4878-979d-7683d9a270d0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:39:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:18 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 Sep 17 23:39:18 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:18 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409" returned: 0 in 0.451s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:18 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409 Sep 17 23:39:18 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:19 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-710fca2c-877a-4814-b884-62fb1d108409" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Lock "cinder-quobyte-710fca2c-877a-4814-b884-62fb1d108409" released by "delete_volume" :: held 2.140s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:19 devstack cinder-volume[85956]: WARNING cinder.quota [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:39:19 devstack cinder-volume[85956]: WARNING cinder.quota [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Created reservations ['51bda42a-2d3b-477c-85eb-cb4087cbfd31', '3d1536d3-5e1f-48a6-879c-86a4295148dd', '587e0495-80e3-4269-92cd-dcca1eb4417f', '6d2fb9a0-e197-49f6-aa7e-6ce2454b9f74'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:19 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:39:19 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:19 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.283s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:39:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Deleted volume successfully. Sep 17 23:39:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bd52451c-64d1-4d45-a2c3-d29adc5ef8d4 tempest-VolumesTestJSON-739060516 None] Lock "cinder-710fca2c-877a-4814-b884-62fb1d108409-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Acquiring lock "cinder-f5f15880-4da1-4be7-b32d-a3737d332907-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Lock "cinder-f5f15880-4da1-4be7-b32d-a3737d332907-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Acquiring lock "cinder-quobyte-f5f15880-4da1-4be7-b32d-a3737d332907" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Lock "cinder-quobyte-f5f15880-4da1-4be7-b32d-a3737d332907" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7877e55e-6674-4ca2-9d6e-b08ce0d50c79]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:39:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:20 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 Sep 17 23:39:20 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:21 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907" returned: 0 in 0.565s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:21 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907 Sep 17 23:39:21 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:21 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f5f15880-4da1-4be7-b32d-a3737d332907" returned: 0 in 0.364s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Lock "cinder-quobyte-f5f15880-4da1-4be7-b32d-a3737d332907" released by "delete_volume" :: held 1.004s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:21 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Created reservations ['e1a40bef-16d2-4e34-a80f-c04a9565c47d', '0f9a36f9-e23f-4b6c-a692-6fab23eadc5c', '35653f16-568d-4e5e-9c28-d466a597a6f2', '16ce6c06-96e6-4823-9dbe-ae37f207e1d8'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:22 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:39:22 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:22 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.482s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:39:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Deleted volume successfully. Sep 17 23:39:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e5c19a35-416a-4423-8a07-b7850049931f tempest-VolumesTestJSON-739060516 None] Lock "cinder-f5f15880-4da1-4be7-b32d-a3737d332907-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Acquiring lock "cinder-8503c11c-6ae8-45a2-8565-c004864f5eeb-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Lock "cinder-8503c11c-6ae8-45a2-8565-c004864f5eeb-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Acquiring lock "cinder-quobyte-8503c11c-6ae8-45a2-8565-c004864f5eeb" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Lock "cinder-quobyte-8503c11c-6ae8-45a2-8565-c004864f5eeb" acquired by "delete_volume" :: waited 0.051s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae9c014-c475-4e30-a7b6-aa8a101dc46d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:39:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:23 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb Sep 17 23:39:23 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:24 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb" returned: 0 in 1.068s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:24 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb Sep 17 23:39:24 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:25 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8503c11c-6ae8-45a2-8565-c004864f5eeb" returned: 0 in 0.407s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Lock "cinder-quobyte-8503c11c-6ae8-45a2-8565-c004864f5eeb" released by "delete_volume" :: held 1.581s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Created reservations ['fd898175-befb-429e-a7fb-453b5bdd835e', '097c6e5a-e072-4f07-aef9-2c2d7c37f181', '95e9c541-b195-4abf-a990-fd0fac1e86ad', '5f810bdc-3275-413f-8f2a-385765930714'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:25 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:39:25 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:25 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.410s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:25 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:39:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Deleted volume successfully. Sep 17 23:39:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-895f7d59-9698-4e6d-80c6-a99b917f1358 tempest-VolumesTestJSON-739060516 None] Lock "cinder-8503c11c-6ae8-45a2-8565-c004864f5eeb-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:28 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Flow 'volume_create_manager' (a356fe40-a30d-4e09-9d88-e0cccd70bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f46542-c732-4997-bf09-aa61d5e81c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f46542-c732-4997-bf09-aa61d5e81c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1038786028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171148ae-6fb8-472a-afe0-a3fb7c5f9554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87762a283c747fab498514fdb09c83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:29Z,use_quota=True,user_id='64a700b55fb74b6cb17960369e1b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bc72a5-da61-4c75-b484-2f3372be51a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bc72a5-da61-4c75-b484-2f3372be51a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5659dc4-dafe-483b-b03c-06c790b6fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5659dc4-dafe-483b-b03c-06c790b6fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171148ae-6fb8-472a-afe0-a3fb7c5f9554', 'volume_name': 'volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d863d363-9be8-4039-8fcf-d566f94813d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d863d363-9be8-4039-8fcf-d566f94813d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bcbec8-92ba-4fb0-8701-3431116b68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:29 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Volume 171148ae-6fb8-472a-afe0-a3fb7c5f9554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554', 'volume_size': 1} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1038786028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171148ae-6fb8-472a-afe0-a3fb7c5f9554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87762a283c747fab498514fdb09c83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:39:29Z,use_quota=True,user_id='64a700b55fb74b6cb17960369e1b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Creating volume 171148ae-6fb8-472a-afe0-a3fb7c5f9554 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:39:29 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:39:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:29 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 1073741824 Sep 17 23:39:29 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:29 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 1073741824" returned: 0 in 0.840s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:30 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 Sep 17 23:39:30 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:30 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554" returned: 0 in 0.480s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bcbec8-92ba-4fb0-8701-3431116b68cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29119eef-d13c-4d4b-bb14-34142ab11ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:39:30 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Volume volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 (171148ae-6fb8-472a-afe0-a3fb7c5f9554): created successfully Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29119eef-d13c-4d4b-bb14-34142ab11ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:39:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Flow 'volume_create_manager' (a356fe40-a30d-4e09-9d88-e0cccd70bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:39:30 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-427600be-9541-4c27-b2d3-343908c8ae12 tempest-VolumesAdminNegativeTest-512614703 None] Created volume successfully. Sep 17 23:39:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Acquiring lock "cinder-171148ae-6fb8-472a-afe0-a3fb7c5f9554-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Lock "cinder-171148ae-6fb8-472a-afe0-a3fb7c5f9554-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Acquiring lock "cinder-quobyte-171148ae-6fb8-472a-afe0-a3fb7c5f9554" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:39:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Lock "cinder-quobyte-171148ae-6fb8-472a-afe0-a3fb7c5f9554" acquired by "delete_volume" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:39:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee7a685-5032-46b5-a642-82350b93f289]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:39:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:33 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 Sep 17 23:39:33 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:34 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554" returned: 0 in 1.318s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:34 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554 Sep 17 23:39:34 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:34 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-171148ae-6fb8-472a-afe0-a3fb7c5f9554" returned: 0 in 0.485s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Lock "cinder-quobyte-171148ae-6fb8-472a-afe0-a3fb7c5f9554" released by "delete_volume" :: held 1.918s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:34 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Created reservations ['76c948e2-e0ea-4bed-8358-1a64359ee931', 'ec380e2b-cb53-45cf-bceb-a7b4ab783d10', 'a158f199-300b-4b48-9140-5bf4182cc01b', '783a3028-2ca5-47dc-830c-07e8abf41255'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:35 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:39:35 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:35 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.468s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:39:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Deleted volume successfully. Sep 17 23:39:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be2a6fbf-64d1-4eca-b8c6-4dd6e6f3c986 tempest-VolumesAdminNegativeTest-512614703 None] Lock "cinder-171148ae-6fb8-472a-afe0-a3fb7c5f9554-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:39:42 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:39:42 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:39:42 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.400s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 8 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:39:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:39:44 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=53,cinder:SELECT=28,cinder:INSERT=12,cinder:DELETE=3 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:39:45 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=32,cinder:INSERT=9,cinder:UPDATE=41,cinder:DELETE=6 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:40:17 devstack cinder-volume[85956]: WARNING py.warnings [req-554820cf-37b5-4ff5-9687-22c8c73ba71e req-9c85ac8b-6939-45c0-986b-c9cf4c8e41ee tempest-TaggedAttachmentsTest-1130789379 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 17 23:40:17 devstack cinder-volume[85956]: .first() Sep 17 23:40:17 devstack cinder-volume[85956]: Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-554820cf-37b5-4ff5-9687-22c8c73ba71e req-9c85ac8b-6939-45c0-986b-c9cf4c8e41ee tempest-TaggedAttachmentsTest-1130789379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-554820cf-37b5-4ff5-9687-22c8c73ba71e req-9c85ac8b-6939-45c0-986b-c9cf4c8e41ee tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-554820cf-37b5-4ff5-9687-22c8c73ba71e req-9c85ac8b-6939-45c0-986b-c9cf4c8e41ee tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-554820cf-37b5-4ff5-9687-22c8c73ba71e req-9c85ac8b-6939-45c0-986b-c9cf4c8e41ee tempest-TaggedAttachmentsTest-1130789379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37eae657-fb72-4e0a-b4bd-16736e8ac85b', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:40:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-554820cf-37b5-4ff5-9687-22c8c73ba71e req-9c85ac8b-6939-45c0-986b-c9cf4c8e41ee tempest-TaggedAttachmentsTest-1130789379 None] attachment_update completed successfully. Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Flow 'volume_create_manager' (7a33bda0-7177-498f-b64f-094ea535b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d16e2a-e65a-4521-9e7d-cea2da9fddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d16e2a-e65a-4521-9e7d-cea2da9fddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-385071871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e27ee-696f-4f5e-9213-d68dc87b8652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0225fa3f7a464cf09ab02ec0b51b9bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:17Z,use_quota=True,user_id='c256bf8908a742deb7dcb7a5d7b4a611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725009b0-7d36-49ec-a290-dcf307f5bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725009b0-7d36-49ec-a290-dcf307f5bc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab8ebfb-30b8-4f26-8a08-936ca96fffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab8ebfb-30b8-4f26-8a08-936ca96fffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477e27ee-696f-4f5e-9213-d68dc87b8652', 'volume_name': 'volume-477e27ee-696f-4f5e-9213-d68dc87b8652', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78356d7-4bea-4fe3-ba03-007ff31121ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78356d7-4bea-4fe3-ba03-007ff31121ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad77accb-8b87-4be1-ba0b-2e2306cd70e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:17 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Volume 477e27ee-696f-4f5e-9213-d68dc87b8652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477e27ee-696f-4f5e-9213-d68dc87b8652', 'volume_size': 1} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-385071871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e27ee-696f-4f5e-9213-d68dc87b8652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0225fa3f7a464cf09ab02ec0b51b9bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:17Z,use_quota=True,user_id='c256bf8908a742deb7dcb7a5d7b4a611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Creating volume 477e27ee-696f-4f5e-9213-d68dc87b8652 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:40:17 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:40:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:17 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 1073741824 Sep 17 23:40:17 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:18 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 1073741824" returned: 0 in 1.257s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:18 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 Sep 17 23:40:18 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:19 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652" returned: 0 in 0.575s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:40:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad77accb-8b87-4be1-ba0b-2e2306cd70e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477e27ee-696f-4f5e-9213-d68dc87b8652', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5b01b3-c5f2-4107-9480-7efd0b258d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:19 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Volume volume-477e27ee-696f-4f5e-9213-d68dc87b8652 (477e27ee-696f-4f5e-9213-d68dc87b8652): created successfully Sep 17 23:40:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5b01b3-c5f2-4107-9480-7efd0b258d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Flow 'volume_create_manager' (7a33bda0-7177-498f-b64f-094ea535b833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ae3c49f0-3126-4741-bcc5-4eb15fb8905b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Created volume successfully. Sep 17 23:40:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Acquiring lock "cinder-477e27ee-696f-4f5e-9213-d68dc87b8652-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "cinder-477e27ee-696f-4f5e-9213-d68dc87b8652-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Acquiring lock "cinder-quobyte-477e27ee-696f-4f5e-9213-d68dc87b8652" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "cinder-quobyte-477e27ee-696f-4f5e-9213-d68dc87b8652" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d448c-b678-40c7-8d5a-883eabfb47a0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:20 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 Sep 17 23:40:20 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:21 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652" returned: 0 in 0.617s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:21 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652 Sep 17 23:40:21 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:21 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-477e27ee-696f-4f5e-9213-d68dc87b8652" returned: 0 in 0.318s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "cinder-quobyte-477e27ee-696f-4f5e-9213-d68dc87b8652" released by "delete_volume" :: held 0.997s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Created reservations ['bbbea14a-c816-43b2-9798-0b7d0421d59d', '0762d005-8369-403f-a206-18e8ecdc073c', 'c7c07703-d480-4efa-90c2-e2465721d135', '779f9ce4-332b-430a-a405-6518961baf75'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:21 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:40:21 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:22 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.356s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:22 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:40:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Deleted volume successfully. Sep 17 23:40:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-38db8dcb-0940-4dc3-b26d-3ad36a93c34d tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "cinder-477e27ee-696f-4f5e-9213-d68dc87b8652-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-036ae2eb-09d2-4061-a1da-7f48e9e9a784 req-05b8ed5b-9d2f-45d4-863f-5aefd9453860 tempest-TaggedAttachmentsTest-1130789379 None] Terminate volume connection completed successfully. Sep 17 23:40:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-036ae2eb-09d2-4061-a1da-7f48e9e9a784 req-05b8ed5b-9d2f-45d4-863f-5aefd9453860 tempest-TaggedAttachmentsTest-1130789379 None] Deleting attachment 37eae657-fb72-4e0a-b4bd-16736e8ac85b. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:40:23 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:40:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Flow 'volume_create_manager' (51ee8a11-92c1-41ba-8fbd-80deaa28152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee8d7e-85d5-4a9c-b896-31bf5084a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee8d7e-85d5-4a9c-b896-31bf5084a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2067829166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0225fa3f7a464cf09ab02ec0b51b9bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:24Z,use_quota=True,user_id='c256bf8908a742deb7dcb7a5d7b4a611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d37882-1df6-417f-a981-3051ad558822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d37882-1df6-417f-a981-3051ad558822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd8b777-3445-4aa5-bf5e-98faabc4cf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd8b777-3445-4aa5-bf5e-98faabc4cf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b', 'volume_name': 'volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca53520-ce6e-452b-b1ce-73400002de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca53520-ce6e-452b-b1ce-73400002de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcc609b-2fe3-4981-852b-c9f5a69a7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Volume 3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b', 'volume_size': 1} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2067829166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0225fa3f7a464cf09ab02ec0b51b9bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:24Z,use_quota=True,user_id='c256bf8908a742deb7dcb7a5d7b4a611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Creating volume 3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:40:24 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:40:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:24 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b 1073741824 Sep 17 23:40:24 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:25 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b 1073741824" returned: 0 in 1.016s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:25 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b Sep 17 23:40:25 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:25 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b" returned: 0 in 0.749s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcc609b-2fe3-4981-852b-c9f5a69a7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df454cb6-3dee-408b-b346-f6730902d0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:25 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Volume volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b (3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b): created successfully Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df454cb6-3dee-408b-b346-f6730902d0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Flow 'volume_create_manager' (51ee8a11-92c1-41ba-8fbd-80deaa28152d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3bd10fbd-712a-49ea-a863-44751f89e78b tempest-VolumeQuotasAdminTestJSON-1665897053 None] Created volume successfully. Sep 17 23:40:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-29c63ccd-8242-4e65-a924-75e9f85d08ac tempest-VolumeQuotasAdminTestJSON-1528008167 None] Transfer volume completed successfully. Sep 17 23:40:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Acquiring lock "cinder-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Lock "cinder-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Acquiring lock "cinder-quobyte-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Lock "cinder-quobyte-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e89abb-6f69-48a7-bdf8-4fc89562c73a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:29 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b Sep 17 23:40:29 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:30 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b" returned: 0 in 0.637s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:30 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b Sep 17 23:40:30 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:30 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b" returned: 0 in 0.295s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Lock "cinder-quobyte-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b" released by "delete_volume" :: held 0.999s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Created reservations ['4faf0ddd-b4f4-4725-9d97-fe8fcd30753a', '6afbee8e-d60b-4630-809b-83cc9e3957af', '6da8e40e-8ab1-4cc9-8854-d591fead3097', 'f053299a-8006-4d0b-b9e2-03c1232cbd74'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:30 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:40:30 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:31 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.677s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:31 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:40:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Deleted volume successfully. Sep 17 23:40:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-182eda24-dc79-4d7b-87b8-fbdcecc6fde1 tempest-VolumeQuotasAdminTestJSON-1876240718 None] Lock "cinder-3bd94dcd-b3cd-4b6c-ab0e-df5d45558e2b-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Flow 'volume_create_manager' (0ed65683-b171-44eb-bb2f-27ef518eeabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e40018-44a9-4c38-b69e-1fc189d0f6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e40018-44a9-4c38-b69e-1fc189d0f6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-27200742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9752cdad-d586-4d7a-9ee9-9a9ebaf03691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3cef815b4f40f9ab81f48a12bc6525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:36Z,use_quota=True,user_id='d56ce7f13f6e4bf38ac7aed77419ceb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7908f226-32db-4df8-a2a1-e7baaef567ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7908f226-32db-4df8-a2a1-e7baaef567ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792a11a7-564a-4952-abb6-ad73ff5ac58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792a11a7-564a-4952-abb6-ad73ff5ac58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9752cdad-d586-4d7a-9ee9-9a9ebaf03691', 'volume_name': 'volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdc6837-a35c-4d57-b256-2fed1e3b47bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdc6837-a35c-4d57-b256-2fed1e3b47bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38aa9fe-cf24-46d8-ad9b-05240952cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Volume 9752cdad-d586-4d7a-9ee9-9a9ebaf03691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691', 'volume_size': 1} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-27200742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9752cdad-d586-4d7a-9ee9-9a9ebaf03691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3cef815b4f40f9ab81f48a12bc6525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:36Z,use_quota=True,user_id='d56ce7f13f6e4bf38ac7aed77419ceb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Creating volume 9752cdad-d586-4d7a-9ee9-9a9ebaf03691 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:40:36 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:36 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 1073741824 Sep 17 23:40:36 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Acquiring lock "cinder-8e8b4ffa-3246-4f5d-8325-30e486d59d5c-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Lock "cinder-8e8b4ffa-3246-4f5d-8325-30e486d59d5c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:36 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 1073741824" returned: 0 in 0.768s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Acquiring lock "cinder-quobyte-8e8b4ffa-3246-4f5d-8325-30e486d59d5c" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Lock "cinder-quobyte-8e8b4ffa-3246-4f5d-8325-30e486d59d5c" acquired by "delete_volume" :: waited 0.051s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:37 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 Sep 17 23:40:37 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3745fc28-6c76-4761-97cc-610c7270f51c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:37 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c Sep 17 23:40:37 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:37 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691" returned: 0 in 0.412s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38aa9fe-cf24-46d8-ad9b-05240952cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5ed8ac-4f40-4b39-9a52-0c965e3c40a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:37 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Volume volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 (9752cdad-d586-4d7a-9ee9-9a9ebaf03691): created successfully Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5ed8ac-4f40-4b39-9a52-0c965e3c40a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Flow 'volume_create_manager' (0ed65683-b171-44eb-bb2f-27ef518eeabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5c3fcbdf-7977-4d5c-99c8-4242a8e4a861 tempest-DeleteServersTestJSON-1631478719 None] Created volume successfully. Sep 17 23:40:37 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c" returned: 0 in 0.524s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:37 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c Sep 17 23:40:37 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:38 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8e8b4ffa-3246-4f5d-8325-30e486d59d5c" returned: 0 in 0.533s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Lock "cinder-quobyte-8e8b4ffa-3246-4f5d-8325-30e486d59d5c" released by "delete_volume" :: held 1.157s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Created reservations ['28ea251c-030c-441b-923e-b37516ba681d', '263d0245-5ae5-4499-9b22-d3064ba5ba19', '7c6f6b79-fb94-4bcd-ae37-7da5f84b6df4', 'aea25eaa-2ef8-4d51-ac83-672d214433ea'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:38 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:40:38 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:38 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.452s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:38 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:40:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Deleted volume successfully. Sep 17 23:40:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-37ed864d-eb26-4801-89cc-f58bce5efd71 tempest-TaggedAttachmentsTest-1130789379 None] Lock "cinder-8e8b4ffa-3246-4f5d-8325-30e486d59d5c-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-e81c9576-e5fc-4a3d-b880-a12485419c98 req-ff715fae-e47e-4a88-9463-3f438d15befc tempest-DeleteServersTestJSON-1631478719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-e81c9576-e5fc-4a3d-b880-a12485419c98 req-ff715fae-e47e-4a88-9463-3f438d15befc tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-e81c9576-e5fc-4a3d-b880-a12485419c98 req-ff715fae-e47e-4a88-9463-3f438d15befc tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-e81c9576-e5fc-4a3d-b880-a12485419c98 req-ff715fae-e47e-4a88-9463-3f438d15befc tempest-DeleteServersTestJSON-1631478719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82bbb6d8-0e5e-490b-bb89-ef55d5afec3b', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:40:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-e81c9576-e5fc-4a3d-b880-a12485419c98 req-ff715fae-e47e-4a88-9463-3f438d15befc tempest-DeleteServersTestJSON-1631478719 None] attachment_update completed successfully. Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:42 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:40:42 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:42 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.514s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 8 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:40:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Flow 'volume_create_manager' (06ebda7f-a4ab-4f92-a4dc-360c016c9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8af091-b5fb-4544-be83-8b892b5fc55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8af091-b5fb-4544-be83-8b892b5fc55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1012532054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b6b381-6c85-4d12-a377-63705af5eb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e458da5d5744d1992a8552466e81e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:43Z,use_quota=True,user_id='14a1527fd97b4901bf5fb961af84a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19046750-eaf4-4603-8559-5ced5e481128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19046750-eaf4-4603-8559-5ced5e481128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9206ae94-2ff9-4b97-9ee9-f0956739be70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9206ae94-2ff9-4b97-9ee9-f0956739be70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b6b381-6c85-4d12-a377-63705af5eb91', 'volume_name': 'volume-67b6b381-6c85-4d12-a377-63705af5eb91', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60980aaf-f6a0-4bd1-81a3-8924444c2e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60980aaf-f6a0-4bd1-81a3-8924444c2e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491799b-831a-471c-9ea7-55086ebd96b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Volume 67b6b381-6c85-4d12-a377-63705af5eb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b6b381-6c85-4d12-a377-63705af5eb91', 'volume_size': 1} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1012532054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b6b381-6c85-4d12-a377-63705af5eb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e458da5d5744d1992a8552466e81e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:43Z,use_quota=True,user_id='14a1527fd97b4901bf5fb961af84a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Creating volume 67b6b381-6c85-4d12-a377-63705af5eb91 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:40:43 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:43 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 1073741824 Sep 17 23:40:43 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:43 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 1073741824" returned: 0 in 0.597s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Flow 'volume_create_manager' (99731649-fe3d-4d92-aec4-f2dd5baf3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad15331b-10e4-4bbd-9f41-42b3f88e4be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad15331b-10e4-4bbd-9f41-42b3f88e4be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1744576976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9f126a-fb04-44f1-829d-3af4d430be25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099f987ae53c492b98283e39ce23e7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:44Z,use_quota=True,user_id='e0c929d556514a32b84dbe4cd1f36d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23aa12ef-815b-4593-9663-5fd91c192ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23aa12ef-815b-4593-9663-5fd91c192ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8681ca3e-4251-4a10-8aba-0c7f4aff2457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8681ca3e-4251-4a10-8aba-0c7f4aff2457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9f126a-fb04-44f1-829d-3af4d430be25', 'volume_name': 'volume-0d9f126a-fb04-44f1-829d-3af4d430be25', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53677182-2838-4bd4-9a8b-00b0dbabbaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53677182-2838-4bd4-9a8b-00b0dbabbaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d630dd9d-3dff-4bcd-9af8-aae799a1c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:43 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Volume 0d9f126a-fb04-44f1-829d-3af4d430be25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9f126a-fb04-44f1-829d-3af4d430be25', 'volume_size': 1} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:43 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 Sep 17 23:40:43 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:44 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91" returned: 0 in 0.340s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1744576976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9f126a-fb04-44f1-829d-3af4d430be25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099f987ae53c492b98283e39ce23e7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:40:44Z,use_quota=True,user_id='e0c929d556514a32b84dbe4cd1f36d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Creating volume 0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:40:44 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491799b-831a-471c-9ea7-55086ebd96b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b6b381-6c85-4d12-a377-63705af5eb91', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29e81aa-5068-4c43-bac4-da587c73d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:44 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 1073741824 Sep 17 23:40:44 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:44 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Volume volume-67b6b381-6c85-4d12-a377-63705af5eb91 (67b6b381-6c85-4d12-a377-63705af5eb91): created successfully Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29e81aa-5068-4c43-bac4-da587c73d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Flow 'volume_create_manager' (06ebda7f-a4ab-4f92-a4dc-360c016c9695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2df8df6c-0042-4e7a-966c-9a2c89ab4ef6 tempest-ServerActionsTestOtherA-1324997458 None] Created volume successfully. Sep 17 23:40:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-4e587a9f-572f-43f6-ac2b-5fe5b8a0a4e3 req-1473a6ec-3780-4387-ab77-a98e6ff95c3b tempest-DeleteServersTestJSON-1631478719 None] Terminate volume connection completed successfully. Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-4e587a9f-572f-43f6-ac2b-5fe5b8a0a4e3 req-1473a6ec-3780-4387-ab77-a98e6ff95c3b tempest-DeleteServersTestJSON-1631478719 None] Deleting attachment 82bbb6d8-0e5e-490b-bb89-ef55d5afec3b. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:40:44 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 1073741824" returned: 0 in 0.591s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:44 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 Sep 17 23:40:44 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:45 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25" returned: 0 in 0.375s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:40:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d630dd9d-3dff-4bcd-9af8-aae799a1c600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9f126a-fb04-44f1-829d-3af4d430be25', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008d0908-fcc9-42e8-8aad-5d08c35f2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:40:45 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Volume volume-0d9f126a-fb04-44f1-829d-3af4d430be25 (0d9f126a-fb04-44f1-829d-3af4d430be25): created successfully Sep 17 23:40:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008d0908-fcc9-42e8-8aad-5d08c35f2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:40:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Flow 'volume_create_manager' (99731649-fe3d-4d92-aec4-f2dd5baf3337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:40:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b992e59c-396e-4ca0-8c7e-a558336c8e47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Created volume successfully. Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Creating offline snapshot cded81b0-6dc5-4880-b7e7-5be35aeee272 of volume 0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7c27f8-f096-49f5-a53f-aa564cbb919d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:46 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 Sep 17 23:40:46 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Acquiring lock "cinder-9752cdad-d586-4d7a-9ee9-9a9ebaf03691-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Lock "cinder-9752cdad-d586-4d7a-9ee9-9a9ebaf03691-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Acquiring lock "cinder-quobyte-9752cdad-d586-4d7a-9ee9-9a9ebaf03691" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Lock "cinder-quobyte-9752cdad-d586-4d7a-9ee9-9a9ebaf03691" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a71b85-0a33-4f18-b5f6-998871468380]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:46 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 Sep 17 23:40:46 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:46 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25" returned: 0 in 0.609s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:46 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 1G Sep 17 23:40:46 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:47 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691" returned: 0 in 0.537s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:47 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691 Sep 17 23:40:47 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:47 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 1G" returned: 0 in 0.530s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9f126a-fb04-44f1-829d-3af4d430be25 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:47 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9f126a-fb04-44f1-829d-3af4d430be25 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 Sep 17 23:40:47 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:47 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9752cdad-d586-4d7a-9ee9-9a9ebaf03691" returned: 0 in 0.312s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Lock "cinder-quobyte-9752cdad-d586-4d7a-9ee9-9a9ebaf03691" released by "delete_volume" :: held 0.906s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Created reservations ['c3771713-b654-4d1a-afdd-d60a49e0e6c9', 'c7d2e4ba-62ea-407d-aad2-930e53ab5366', '008dd67a-7f05-4155-ad67-0fead0f3bebc', '6090b245-15ab-4957-b610-4a98af732e0d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:47 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:40:47 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:47 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d9f126a-fb04-44f1-829d-3af4d430be25 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272" returned: 0 in 0.374s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:47 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 is being set with open permissions: ugo+rw Sep 17 23:40:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:47 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 Sep 17 23:40:47 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:48 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.382s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:40:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Deleted volume successfully. Sep 17 23:40:48 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272" returned: 0 in 0.377s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91414df1-50d8-4aaa-baeb-435a6fd16105 tempest-DeleteServersTestJSON-1631478719 None] Lock "cinder-9752cdad-d586-4d7a-9ee9-9a9ebaf03691-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:48 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.info Sep 17 23:40:48 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:48 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.info" returned: 0 in 0.315s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:48 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.info is being set with open permissions: ugo+rw Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:48 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.info Sep 17 23:40:48 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:48 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.info" returned: 0 in 0.322s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-76353dce-cb40-43d0-a663-02bbe15d3775 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Create snapshot completed successfully Sep 17 23:40:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "cinder-cded81b0-6dc5-4880-b7e7-5be35aeee272-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-cded81b0-6dc5-4880-b7e7-5be35aeee272-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "cinder-quobyte-0d9f126a-fb04-44f1-829d-3af4d430be25" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-quobyte-0d9f126a-fb04-44f1-829d-3af4d430be25" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "cinder-quobyte-cded81b0-6dc5-4880-b7e7-5be35aeee272" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-quobyte-cded81b0-6dc5-4880-b7e7-5be35aeee272" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Deleting offline snapshot cded81b0-6dc5-4880-b7e7-5be35aeee272 of volume 0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] snapshot_file for this snap is: volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e4cc73-2525-4e23-a29e-75dab0f9cea6]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:50 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 Sep 17 23:40:50 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:50 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272" returned: 0 in 0.381s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d9f126a-fb04-44f1-829d-3af4d430be25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e44dfb-ee00-4a41-b1fb-53eb3f9a87ea]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:50 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 Sep 17 23:40:50 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:50 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25" returned: 0 in 0.484s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:51 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 Sep 17 23:40:51 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:51 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272" returned: 0 in 0.398s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:51 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272 Sep 17 23:40:51 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:51 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25.cded81b0-6dc5-4880-b7e7-5be35aeee272" returned: 0 in 0.274s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-quobyte-cded81b0-6dc5-4880-b7e7-5be35aeee272" released by "_delete_snapshot" :: held 1.673s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-quobyte-0d9f126a-fb04-44f1-829d-3af4d430be25" released by "delete_snapshot" :: held 1.704s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:51 devstack cinder-volume[85956]: WARNING cinder.quota [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:40:51 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Created reservations ['cfde012f-c57b-4ce4-92c8-f82917bb1795', 'a017f577-4ffc-4c3c-b51e-cf92d533e42a', 'c5bc898b-2137-4292-83ce-f00f64291cb4', 'e9eaba42-9e39-4264-8e30-4650e3a87c88'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:40:51 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Delete snapshot completed successfully. Sep 17 23:40:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c9e616f3-7edd-423a-834e-1bec8f4c917c tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-cded81b0-6dc5-4880-b7e7-5be35aeee272-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "cinder-0d9f126a-fb04-44f1-829d-3af4d430be25-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-0d9f126a-fb04-44f1-829d-3af4d430be25-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "cinder-quobyte-0d9f126a-fb04-44f1-829d-3af4d430be25" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-quobyte-0d9f126a-fb04-44f1-829d-3af4d430be25" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e758ef4-2217-4fe8-b683-ec7e318a5d76]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:52 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 Sep 17 23:40:52 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:52 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25" returned: 0 in 0.434s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:52 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25 Sep 17 23:40:52 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:53 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0d9f126a-fb04-44f1-829d-3af4d430be25" returned: 0 in 0.371s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-quobyte-0d9f126a-fb04-44f1-829d-3af4d430be25" released by "delete_volume" :: held 0.880s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Created reservations ['72f57718-dfab-48b9-b581-606b686410c0', 'eeb04ef0-3b25-4125-9932-c0397908d4b2', 'e2ff9c2f-2152-42a7-8905-70a4f237744c', 'a47e10e6-93b1-47ae-bde7-6a133b452f91'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:40:53 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:40:53 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:40:53 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.412s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:40:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Deleted volume successfully. Sep 17 23:40:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b2b15cf9-e369-4e27-9679-2b0316bbf042 tempest-VolumeSnapshotQuotasNegativeTestJSON-1722307592 None] Lock "cinder-0d9f126a-fb04-44f1-829d-3af4d430be25-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:41:03 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=69,cinder:UPDATE=61,cinder:INSERT=15,cinder:DELETE=6 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:41:03 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=51,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=5 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:41:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1de6294e-d272-4cb1-b69a-2e957ac582e4 req-53d9b4cf-2085-4306-9f30-707990e5a3d9 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:41:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1de6294e-d272-4cb1-b69a-2e957ac582e4 req-53d9b4cf-2085-4306-9f30-707990e5a3d9 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:41:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1de6294e-d272-4cb1-b69a-2e957ac582e4 req-53d9b4cf-2085-4306-9f30-707990e5a3d9 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:41:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-1de6294e-d272-4cb1-b69a-2e957ac582e4 req-53d9b4cf-2085-4306-9f30-707990e5a3d9 tempest-ServerActionsTestOtherA-1324997458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-67b6b381-6c85-4d12-a377-63705af5eb91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6d183b1-082a-40af-b148-ba3d5fbfb54e', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:41:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-1de6294e-d272-4cb1-b69a-2e957ac582e4 req-53d9b4cf-2085-4306-9f30-707990e5a3d9 tempest-ServerActionsTestOtherA-1324997458 None] attachment_update completed successfully. Sep 17 23:41:34 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-f8d7925d-0906-4e34-a09d-2e0146c903e9 req-16d1d6d7-5512-4308-a7b3-d3a6d0bfe762 tempest-ServerActionsTestOtherA-1324997458 None] Terminate volume connection completed successfully. Sep 17 23:41:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-f8d7925d-0906-4e34-a09d-2e0146c903e9 req-16d1d6d7-5512-4308-a7b3-d3a6d0bfe762 tempest-ServerActionsTestOtherA-1324997458 None] Deleting attachment e6d183b1-082a-40af-b148-ba3d5fbfb54e. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:41:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-f8d7925d-0906-4e34-a09d-2e0146c903e9 req-d9af8292-7860-4165-8d2f-c95680449427 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:41:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-f8d7925d-0906-4e34-a09d-2e0146c903e9 req-d9af8292-7860-4165-8d2f-c95680449427 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:41:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-f8d7925d-0906-4e34-a09d-2e0146c903e9 req-d9af8292-7860-4165-8d2f-c95680449427 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:41:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-f8d7925d-0906-4e34-a09d-2e0146c903e9 req-d9af8292-7860-4165-8d2f-c95680449427 tempest-ServerActionsTestOtherA-1324997458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-67b6b381-6c85-4d12-a377-63705af5eb91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57d5fb85-f089-4972-b4b9-3c36fe659bd2', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:41:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-f8d7925d-0906-4e34-a09d-2e0146c903e9 req-d9af8292-7860-4165-8d2f-c95680449427 tempest-ServerActionsTestOtherA-1324997458 None] attachment_update completed successfully. Sep 17 23:41:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:41:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:41:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:41:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:41:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:41:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:41:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:41:42 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:41:42 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:41:43 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Sep 17 23:41:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 1.032s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:41:43 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:41:43 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:41:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 8 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:41:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:41:47 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:41:47 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Flow 'volume_create_manager' (0c2eaaa2-7b35-4259-9da0-75a7affe8949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35af7606-3747-44fe-ae86-db1bb5a8e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35af7606-3747-44fe-ae86-db1bb5a8e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1585181576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d7e23c-c273-43f0-9329-1e842506330a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed76dae1805645f195706ccfd75dd467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:00Z,use_quota=True,user_id='13db026778ce497f9af190187a7d449f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22049b49-e360-4c2e-972a-4f71038c9423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22049b49-e360-4c2e-972a-4f71038c9423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bdf711-3513-4605-a1bc-25c3745054e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bdf711-3513-4605-a1bc-25c3745054e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d7e23c-c273-43f0-9329-1e842506330a', 'volume_name': 'volume-28d7e23c-c273-43f0-9329-1e842506330a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5c180b-c76c-4015-b081-b2b64c4aa5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5c180b-c76c-4015-b081-b2b64c4aa5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aa2459-2c9c-405b-be2c-3c3730c73bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:41:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Volume 28d7e23c-c273-43f0-9329-1e842506330a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d7e23c-c273-43f0-9329-1e842506330a', 'volume_size': 1} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1585181576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d7e23c-c273-43f0-9329-1e842506330a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed76dae1805645f195706ccfd75dd467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:00Z,use_quota=True,user_id='13db026778ce497f9af190187a7d449f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Creating volume 28d7e23c-c273-43f0-9329-1e842506330a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:41:59 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:41:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:41:59 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a 1073741824 Sep 17 23:41:59 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:00 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a 1073741824" returned: 0 in 0.809s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:00 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a Sep 17 23:42:00 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Flow 'volume_create_manager' (b1cf334a-bfab-4880-ac3b-411f99745ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:00 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f986c-fae8-4e9a-a5c8-abeed2ee4a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a" returned: 0 in 0.290s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f986c-fae8-4e9a-a5c8-abeed2ee4a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-102377131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c1d187-a0d9-4a26-9b45-6b8c82f80171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80020fd9885432d85c2f28b898b51c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:01Z,use_quota=True,user_id='7c87f85f470e4af8b7781aba39db4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8e4024-3238-44c0-9beb-1e933bc2c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8e4024-3238-44c0-9beb-1e933bc2c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4839e74b-66a1-4d56-a6f0-7b78c6bc4758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4839e74b-66a1-4d56-a6f0-7b78c6bc4758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c1d187-a0d9-4a26-9b45-6b8c82f80171', 'volume_name': 'volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc16646-f1da-4324-97e1-96edd70b52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc16646-f1da-4324-97e1-96edd70b52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2885cd-6aca-4b4f-b0a5-7abf4fda65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:00 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Volume f9c1d187-a0d9-4a26-9b45-6b8c82f80171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171', 'volume_size': 1} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-102377131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c1d187-a0d9-4a26-9b45-6b8c82f80171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80020fd9885432d85c2f28b898b51c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:01Z,use_quota=True,user_id='7c87f85f470e4af8b7781aba39db4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Creating volume f9c1d187-a0d9-4a26-9b45-6b8c82f80171 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:00 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aa2459-2c9c-405b-be2c-3c3730c73bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d7e23c-c273-43f0-9329-1e842506330a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012e9fac-c583-4c97-a320-b42ff5b48e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:01 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 1073741824 Sep 17 23:42:01 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Volume volume-28d7e23c-c273-43f0-9329-1e842506330a (28d7e23c-c273-43f0-9329-1e842506330a): created successfully Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012e9fac-c583-4c97-a320-b42ff5b48e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Flow 'volume_create_manager' (0c2eaaa2-7b35-4259-9da0-75a7affe8949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6ff5da72-c98b-4534-b29e-7cbb8b772fe4 tempest-ServersNegativeTestJSON-1736462126 None] Created volume successfully. Sep 17 23:42:01 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 1073741824" returned: 0 in 0.479s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:01 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 Sep 17 23:42:01 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:01 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171" returned: 0 in 0.371s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2885cd-6aca-4b4f-b0a5-7abf4fda65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62870d4-23c9-42d5-9590-1ca22ae3d8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Volume volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 (f9c1d187-a0d9-4a26-9b45-6b8c82f80171): created successfully Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62870d4-23c9-42d5-9590-1ca22ae3d8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Flow 'volume_create_manager' (b1cf334a-bfab-4880-ac3b-411f99745ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-879a5b8f-2e33-4466-b793-9a323e641327 tempest-AttachVolumeNegativeTest-1295557150 None] Created volume successfully. Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (136ff5b1-fc1c-4ab5-8399-a06aa3e61aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7278e69e-9800-46ae-bb8f-5dd58025ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7278e69e-9800-46ae-bb8f-5dd58025ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-470619402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e4e274-1b40-4a6a-b076-adc18e5ee029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:02Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ae1dff-bcd1-40b4-88b2-3f7d41a058c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ae1dff-bcd1-40b4-88b2-3f7d41a058c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9989ec-bfe7-4488-a511-c0e7f350b6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9989ec-bfe7-4488-a511-c0e7f350b6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e4e274-1b40-4a6a-b076-adc18e5ee029', 'volume_name': 'volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37e599c-34a1-4fff-a41a-a1094c3ead68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37e599c-34a1-4fff-a41a-a1094c3ead68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ea7126-6cc0-4aee-8fe4-361c6042d8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:02 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Volume b2e4e274-1b40-4a6a-b076-adc18e5ee029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029', 'volume_size': 1} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-470619402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e4e274-1b40-4a6a-b076-adc18e5ee029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:02Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Creating volume b2e4e274-1b40-4a6a-b076-adc18e5ee029 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:02 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:02 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 1073741824 Sep 17 23:42:02 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:03 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 1073741824" returned: 0 in 0.533s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:03 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 Sep 17 23:42:03 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:03 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Flow 'volume_create_manager' (b2d31485-f847-4217-b4e8-ac8b40416809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58134625-3f08-47bb-8ffb-0bcaaa50d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029" returned: 0 in 0.428s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58134625-3f08-47bb-8ffb-0bcaaa50d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-627292189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccba0ca1-228f-4c73-8083-78f7df721f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed76dae1805645f195706ccfd75dd467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:03Z,use_quota=True,user_id='13db026778ce497f9af190187a7d449f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0f58a8-c0e6-4820-8d52-f498d79b5c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0f58a8-c0e6-4820-8d52-f498d79b5c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed37d76-31bb-4289-b04a-641d9d973586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed37d76-31bb-4289-b04a-641d9d973586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccba0ca1-228f-4c73-8083-78f7df721f71', 'volume_name': 'volume-ccba0ca1-228f-4c73-8083-78f7df721f71', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3102c7b-53d8-4579-961a-66fac28981fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3102c7b-53d8-4579-961a-66fac28981fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34909167-2f82-4c5f-897a-8fba750934db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:03 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Volume ccba0ca1-228f-4c73-8083-78f7df721f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccba0ca1-228f-4c73-8083-78f7df721f71', 'volume_size': 1} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-627292189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccba0ca1-228f-4c73-8083-78f7df721f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed76dae1805645f195706ccfd75dd467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:03Z,use_quota=True,user_id='13db026778ce497f9af190187a7d449f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Creating volume ccba0ca1-228f-4c73-8083-78f7df721f71 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:03 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ea7126-6cc0-4aee-8fe4-361c6042d8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97424297-3a3a-43b0-97f5-349aaf527143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:03 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 1073741824 Sep 17 23:42:03 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:03 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Volume volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 (b2e4e274-1b40-4a6a-b076-adc18e5ee029): created successfully Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97424297-3a3a-43b0-97f5-349aaf527143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (136ff5b1-fc1c-4ab5-8399-a06aa3e61aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-55099b46-0678-4e92-bb83-0c8e6ac8ea60 tempest-VolumesActionsTest-749761007 None] Created volume successfully. Sep 17 23:42:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-e34acd52-1a18-46b8-9608-fac74e250368 req-ca3defe7-2d17-436d-b88e-2558185f92ff tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:04 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 1073741824" returned: 0 in 0.504s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:04 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 Sep 17 23:42:04 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:04 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71" returned: 0 in 0.263s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-e34acd52-1a18-46b8-9608-fac74e250368 req-ca3defe7-2d17-436d-b88e-2558185f92ff tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.509s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34909167-2f82-4c5f-897a-8fba750934db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccba0ca1-228f-4c73-8083-78f7df721f71', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aed44f-4815-46b9-8afd-59ea4d61c919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-e34acd52-1a18-46b8-9608-fac74e250368 req-ca3defe7-2d17-436d-b88e-2558185f92ff tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:04 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Volume volume-ccba0ca1-228f-4c73-8083-78f7df721f71 (ccba0ca1-228f-4c73-8083-78f7df721f71): created successfully Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aed44f-4815-46b9-8afd-59ea4d61c919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Flow 'volume_create_manager' (b2d31485-f847-4217-b4e8-ac8b40416809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-99f5bfb5-72b2-4160-8d8a-77e375fd0108 tempest-ServersNegativeTestJSON-1736462126 None] Created volume successfully. Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7cf12d66-c504-486d-8d9b-9daa09b07662 tempest-VolumesActionsTest-749761007 None] Acquiring lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029" by "attach_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-e34acd52-1a18-46b8-9608-fac74e250368 req-ca3defe7-2d17-436d-b88e-2558185f92ff tempest-AttachVolumeNegativeTest-1295557150 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70edd3af-58b8-48ce-953d-7a7605a52ac6', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7cf12d66-c504-486d-8d9b-9daa09b07662 tempest-VolumesActionsTest-749761007 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029" acquired by "attach_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-e34acd52-1a18-46b8-9608-fac74e250368 req-ca3defe7-2d17-436d-b88e-2558185f92ff tempest-AttachVolumeNegativeTest-1295557150 None] attachment_update completed successfully. Sep 17 23:42:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7cf12d66-c504-486d-8d9b-9daa09b07662 tempest-VolumesActionsTest-749761007 None] Attaching volume b2e4e274-1b40-4a6a-b076-adc18e5ee029 to instance b75a1c54-b25a-4733-b87e-78e42635a09c at mountpoint /dev/vdb on host None. Sep 17 23:42:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7cf12d66-c504-486d-8d9b-9daa09b07662 tempest-VolumesActionsTest-749761007 None] Attach volume completed successfully. Sep 17 23:42:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7cf12d66-c504-486d-8d9b-9daa09b07662 tempest-VolumesActionsTest-749761007 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029" released by "attach_volume" :: held 0.130s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0be8a6d4-f6ab-4893-8b39-c764e128f2e5 tempest-VolumesActionsTest-1501849670 None] Terminate volume connection completed successfully. Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0be8a6d4-f6ab-4893-8b39-c764e128f2e5 tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-detach_volume" by "detach_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0be8a6d4-f6ab-4893-8b39-c764e128f2e5 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0be8a6d4-f6ab-4893-8b39-c764e128f2e5 tempest-VolumesActionsTest-1501849670 None] Detaching volume b2e4e274-1b40-4a6a-b076-adc18e5ee029 from instance b75a1c54-b25a-4733-b87e-78e42635a09c. Sep 17 23:42:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0be8a6d4-f6ab-4893-8b39-c764e128f2e5 tempest-VolumesActionsTest-1501849670 None] Detach volume completed successfully. Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0be8a6d4-f6ab-4893-8b39-c764e128f2e5 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c852eed3-1450-4659-8cbd-bfb1771484ed tempest-VolumesActionsTest-749761007 None] Acquiring lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-detach_volume" by "detach_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c852eed3-1450-4659-8cbd-bfb1771484ed tempest-VolumesActionsTest-749761007 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c852eed3-1450-4659-8cbd-bfb1771484ed tempest-VolumesActionsTest-749761007 None] Volume detach called, but volume not attached. Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c852eed3-1450-4659-8cbd-bfb1771484ed tempest-VolumesActionsTest-749761007 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "cinder-ccba0ca1-228f-4c73-8083-78f7df721f71-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-ccba0ca1-228f-4c73-8083-78f7df721f71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "cinder-quobyte-ccba0ca1-228f-4c73-8083-78f7df721f71" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-quobyte-ccba0ca1-228f-4c73-8083-78f7df721f71" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b54332e-5215-46b1-8be9-ab40d2d6778c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Acquiring lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Acquiring lock "cinder-quobyte-b2e4e274-1b40-4a6a-b076-adc18e5ee029" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:06 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 Sep 17 23:42:06 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Lock "cinder-quobyte-b2e4e274-1b40-4a6a-b076-adc18e5ee029" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba86ec1-9679-45c7-a207-c28591a96fb1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:06 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 Sep 17 23:42:06 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:06 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71" returned: 0 in 0.567s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:06 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71 Sep 17 23:42:06 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:06 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029" returned: 0 in 0.576s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:06 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029 Sep 17 23:42:06 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:07 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ccba0ca1-228f-4c73-8083-78f7df721f71" returned: 0 in 0.680s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-quobyte-ccba0ca1-228f-4c73-8083-78f7df721f71" released by "delete_volume" :: held 1.334s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Created reservations ['76efbce7-0cac-46c1-86b0-b1bae72fcad6', '082ea2ad-d12e-44b1-95b2-f17ab0b8ca05', '35dee936-02a7-4ac2-87a8-b59ed93c0d10', '7d968a35-9c7f-4353-96bf-866937f0858e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:07 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b2e4e274-1b40-4a6a-b076-adc18e5ee029" returned: 0 in 0.679s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Lock "cinder-quobyte-b2e4e274-1b40-4a6a-b076-adc18e5ee029" released by "delete_volume" :: held 1.314s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:07 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:07 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Created reservations ['f2a20a3e-3ff4-47ef-927e-e96ba9f11141', '8a3edda9-5a75-48cc-ae5f-27702d57dfc9', '3ecd2adb-760c-4a22-a953-810f2d8c3037', 'c8634a5f-abb2-444c-b2c3-f9d0072ab55b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:07 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.426s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Deleted volume successfully. Sep 17 23:42:08 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97523bc1-1bb2-43df-9a56-f4f098396db8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-ccba0ca1-228f-4c73-8083-78f7df721f71-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:08 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "cinder-28d7e23c-c273-43f0-9329-1e842506330a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-28d7e23c-c273-43f0-9329-1e842506330a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "cinder-quobyte-28d7e23c-c273-43f0-9329-1e842506330a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-quobyte-28d7e23c-c273-43f0-9329-1e842506330a" acquired by "delete_volume" :: waited 0.049s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ceefe9-a6cc-44da-865d-6c7c46a530e0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:08 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.842s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Deleted volume successfully. Sep 17 23:42:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf26e2f9-7480-41b0-93fd-4699f996eceb tempest-VolumesActionsTest-749761007 None] Lock "cinder-b2e4e274-1b40-4a6a-b076-adc18e5ee029-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:09 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a Sep 17 23:42:09 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:09 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a" returned: 0 in 0.683s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:09 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a Sep 17 23:42:09 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:09 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-28d7e23c-c273-43f0-9329-1e842506330a" returned: 0 in 0.488s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-quobyte-28d7e23c-c273-43f0-9329-1e842506330a" released by "delete_volume" :: held 1.285s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Created reservations ['e502da32-6cf7-41ea-ae8b-bf8862e36fb7', '0bfc4e20-8acf-4afc-8f35-c0e5c6255d76', 'c0036efc-7a08-4f54-af55-da025a783acb', 'e24f1b39-d7e5-4ef8-b166-f4de222980c9'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:10 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:10 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:10 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.408s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Deleted volume successfully. Sep 17 23:42:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-596330cd-63c0-42b3-a1ea-e27ec1ae07b8 tempest-ServersNegativeTestJSON-1736462126 None] Lock "cinder-28d7e23c-c273-43f0-9329-1e842506330a-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (b64869ab-5e3d-4bd4-87e5-804299445433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b77832a-5edb-4a67-bb72-637f155a8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b77832a-5edb-4a67-bb72-637f155a8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64867131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5959e80-b5bb-4ddd-87e9-fbd94d099bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:13Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dce1639-0350-4285-9774-09cba19ca024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dce1639-0350-4285-9774-09cba19ca024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de604ad-0d7c-480b-bde3-00794e2b7874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de604ad-0d7c-480b-bde3-00794e2b7874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5959e80-b5bb-4ddd-87e9-fbd94d099bdc', 'volume_name': 'volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15190b1-57c2-4dd2-bc95-f85729466722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15190b1-57c2-4dd2-bc95-f85729466722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7346f01a-57ef-40ca-a81d-7028ba92894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:12 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Volume a5959e80-b5bb-4ddd-87e9-fbd94d099bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc', 'volume_size': 1} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64867131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5959e80-b5bb-4ddd-87e9-fbd94d099bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:13Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Creating volume a5959e80-b5bb-4ddd-87e9-fbd94d099bdc {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:12 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:12 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc 1073741824 Sep 17 23:42:12 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:13 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc 1073741824" returned: 0 in 0.629s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:13 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc Sep 17 23:42:13 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:13 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc" returned: 0 in 0.310s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7346f01a-57ef-40ca-a81d-7028ba92894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f788c10a-5796-4867-b346-79081efdb522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Volume volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc (a5959e80-b5bb-4ddd-87e9-fbd94d099bdc): created successfully Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f788c10a-5796-4867-b346-79081efdb522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (b64869ab-5e3d-4bd4-87e5-804299445433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:13 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b922ea05-d62b-4de8-b58d-4208f776936d tempest-VolumesActionsTest-749761007 None] Created volume successfully. Sep 17 23:42:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-f9df2b9c-d473-4a45-b417-9dccc1cc0cd9 req-b71202a1-988d-4e35-bb7c-f9c225b7e5e0 tempest-ServerActionsTestOtherA-1324997458 None] Terminate volume connection completed successfully. Sep 17 23:42:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-f9df2b9c-d473-4a45-b417-9dccc1cc0cd9 req-b71202a1-988d-4e35-bb7c-f9c225b7e5e0 tempest-ServerActionsTestOtherA-1324997458 None] Deleting attachment 57d5fb85-f089-4972-b4b9-3c36fe659bd2. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-quobyte-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c0bd44-a497-48dd-a09e-288ed67c7c63]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:15 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc Sep 17 23:42:15 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:15 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc" returned: 0 in 0.501s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:15 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc Sep 17 23:42:15 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:16 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc" returned: 0 in 0.344s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc" released by "delete_volume" :: held 0.909s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Created reservations ['73ebdda2-b82d-43f3-90a2-7a21ffe136f3', '7e7ed77d-7eb9-4ffc-b8a4-eac03cfcc943', '88b1ea24-c971-4571-80c2-91f21f6c04fa', '4e316a7b-a5b6-4a7b-bac9-7d5ad1ba62b7'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:16 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:16 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:16 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.322s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Deleted volume successfully. Sep 17 23:42:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d31487c4-9b24-4a44-a0ac-639dbbc2d262 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-a5959e80-b5bb-4ddd-87e9-fbd94d099bdc-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (86c40683-617d-41c6-a9af-2b471594520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55134e2e-3d07-4e82-bb35-71ac17241c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55134e2e-3d07-4e82-bb35-71ac17241c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-670736955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c345263-4f72-4933-b1dd-fc5c78d239ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:18Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e2140c-9d2d-4352-9f79-c211fd7d02b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e2140c-9d2d-4352-9f79-c211fd7d02b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a2777c-0301-4531-a966-ba257d0d0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a2777c-0301-4531-a966-ba257d0d0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c345263-4f72-4933-b1dd-fc5c78d239ce', 'volume_name': 'volume-2c345263-4f72-4933-b1dd-fc5c78d239ce', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc1e07a-b68d-49bd-9ed7-58f4e33daff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc1e07a-b68d-49bd-9ed7-58f4e33daff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abca86b8-aaed-4e59-ae63-97d39ed7217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:18 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Volume 2c345263-4f72-4933-b1dd-fc5c78d239ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c345263-4f72-4933-b1dd-fc5c78d239ce', 'volume_size': 1} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-670736955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c345263-4f72-4933-b1dd-fc5c78d239ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:18Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Creating volume 2c345263-4f72-4933-b1dd-fc5c78d239ce {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:18 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:18 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce 1073741824 Sep 17 23:42:18 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:18 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce 1073741824" returned: 0 in 0.600s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:18 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce Sep 17 23:42:18 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:19 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce" returned: 0 in 0.380s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abca86b8-aaed-4e59-ae63-97d39ed7217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c345263-4f72-4933-b1dd-fc5c78d239ce', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde802c1-3e50-41a5-834e-2339b7a0310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:19 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Volume volume-2c345263-4f72-4933-b1dd-fc5c78d239ce (2c345263-4f72-4933-b1dd-fc5c78d239ce): created successfully Sep 17 23:42:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde802c1-3e50-41a5-834e-2339b7a0310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (86c40683-617d-41c6-a9af-2b471594520e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-39d5bd0a-c98b-40d1-8d54-780ede8aae98 tempest-VolumesActionsTest-749761007 None] Created volume successfully. Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-2c345263-4f72-4933-b1dd-fc5c78d239ce-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Lock "cinder-2c345263-4f72-4933-b1dd-fc5c78d239ce-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-quobyte-2c345263-4f72-4933-b1dd-fc5c78d239ce" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-2c345263-4f72-4933-b1dd-fc5c78d239ce" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e581a24-0695-4d61-bfc4-7c981093de9d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:20 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce Sep 17 23:42:20 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:20 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce" returned: 0 in 0.446s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:20 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce Sep 17 23:42:21 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:21 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c345263-4f72-4933-b1dd-fc5c78d239ce" returned: 0 in 0.316s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-2c345263-4f72-4933-b1dd-fc5c78d239ce" released by "delete_volume" :: held 0.838s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Created reservations ['63ab234e-25e4-41de-95fa-cd71931276ae', 'a6c5804d-4096-47e9-ba80-0e01cd3ef61c', 'cbb22981-990c-471f-b098-34fe43fe1cef', '6502308c-eea3-432a-9565-627c8e4f53c9'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:21 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:21 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:22 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.680s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Deleted volume successfully. Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-224d4d26-b5d3-4d4d-b200-f349172ef50d tempest-VolumesActionsTest-1501849670 None] Lock "cinder-2c345263-4f72-4933-b1dd-fc5c78d239ce-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (3c17613e-263c-4769-8709-d3498f6f2a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f13ceff-5625-4005-ae12-640e94252ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f13ceff-5625-4005-ae12-640e94252ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944936945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6eddb3-4080-486d-b2c6-05ade4755e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:23Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c44c9d-aaa8-4ad3-9916-c744cd47898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c44c9d-aaa8-4ad3-9916-c744cd47898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0a79ae-a287-4712-a030-82a0225aafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0a79ae-a287-4712-a030-82a0225aafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6eddb3-4080-486d-b2c6-05ade4755e58', 'volume_name': 'volume-7b6eddb3-4080-486d-b2c6-05ade4755e58', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5a3e42-f1cd-4e91-963c-8febcbc58696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5a3e42-f1cd-4e91-963c-8febcbc58696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b953fb-8af3-4ced-ae82-a0a00b7fef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Volume 7b6eddb3-4080-486d-b2c6-05ade4755e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6eddb3-4080-486d-b2c6-05ade4755e58', 'volume_size': 1} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944936945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6eddb3-4080-486d-b2c6-05ade4755e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:23Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Creating volume 7b6eddb3-4080-486d-b2c6-05ade4755e58 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:22 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:22 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 1073741824 Sep 17 23:42:22 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:23 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 1073741824" returned: 0 in 0.750s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:23 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 Sep 17 23:42:23 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Flow 'volume_create_manager' (2eedf750-271c-4a6f-a05d-9460fcc5a88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b146aef-e0a0-4b18-a155-efb820a696ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b146aef-e0a0-4b18-a155-efb820a696ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-817626959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91fc92f-ea7b-4e46-a5ed-df942769d457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e458da5d5744d1992a8552466e81e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:24Z,use_quota=True,user_id='14a1527fd97b4901bf5fb961af84a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091e5e48-dfe9-48a3-b188-42ebb829294c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091e5e48-dfe9-48a3-b188-42ebb829294c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef28f02e-bcda-4d92-97c7-38720600a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:23 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:42:24 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58" returned: 0 in 0.378s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b953fb-8af3-4ced-ae82-a0a00b7fef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6eddb3-4080-486d-b2c6-05ade4755e58', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fc3823-e8e1-479c-b32a-195854a94192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Volume volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 (7b6eddb3-4080-486d-b2c6-05ade4755e58): created successfully Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fc3823-e8e1-479c-b32a-195854a94192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (3c17613e-263c-4769-8709-d3498f6f2a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-405549f5-c179-45da-b095-e6ce90857073 tempest-VolumesActionsTest-749761007 None] Created volume successfully. Sep 17 23:42:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-7b6eddb3-4080-486d-b2c6-05ade4755e58-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-7b6eddb3-4080-486d-b2c6-05ade4755e58-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-quobyte-7b6eddb3-4080-486d-b2c6-05ade4755e58" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-7b6eddb3-4080-486d-b2c6-05ade4755e58" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb3e44f-1cc1-4cb5-bc5a-cef2e8f8497c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:25 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 Sep 17 23:42:25 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef28f02e-bcda-4d92-97c7-38720600a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e91fc92f-ea7b-4e46-a5ed-df942769d457', 'volume_name': 'volume-e91fc92f-ea7b-4e46-a5ed-df942769d457', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece63bf8-f19c-4fe5-ac48-ba1d9e4ce4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece63bf8-f19c-4fe5-ac48-ba1d9e4ce4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4973d0ab-3ac3-417e-875d-b0533a1b0dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:25 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Volume e91fc92f-ea7b-4e46-a5ed-df942769d457: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e91fc92f-ea7b-4e46-a5ed-df942769d457', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Trying to clone e91fc92f-ea7b-4e46-a5ed-df942769d457 from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:42:25 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58" returned: 0 in 0.628s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:25 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58 Sep 17 23:42:25 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:42:26 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Image download 20.69 MB at 20.69 MB/s Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7066ed9-e5e7-4cb9-b999-3b255ded1ddd]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:26 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7b6eddb3-4080-486d-b2c6-05ade4755e58" returned: 0 in 0.510s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-7b6eddb3-4080-486d-b2c6-05ade4755e58" released by "delete_volume" :: held 1.218s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:26 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD Sep 17 23:42:26 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Created reservations ['be9a6e55-253e-4aa4-b381-bacb65f5f37c', '04a880d5-75a3-4908-a7ca-86897170e192', '711a424a-d194-4575-bc5e-cfb6ccfa1888', '30ac17c4-568d-46f5-9d96-ba582c0c73aa'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:26 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:26 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:26 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee is fetched for user 14a1527fd97b4901bf5fb961af84a8be. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[23256993-badb-4e63-8f6d-415d67126093]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:26 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.368s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Deleted volume successfully. Sep 17 23:42:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b69f62d-2aaa-430d-a294-5505e9b76a79 tempest-VolumesActionsTest-1501849670 None] Lock "cinder-7b6eddb3-4080-486d-b2c6-05ade4755e58-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:26 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD Sep 17 23:42:26 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:27 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-817626959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91fc92f-ea7b-4e46-a5ed-df942769d457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e458da5d5744d1992a8552466e81e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:24Z,use_quota=True,user_id='14a1527fd97b4901bf5fb961af84a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Creating volume e91fc92f-ea7b-4e46-a5ed-df942769d457 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:27 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:27 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 1073741824 Sep 17 23:42:27 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:27 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 1073741824" returned: 0 in 0.640s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:27 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 Sep 17 23:42:27 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7019a6e9-ac2b-4319-9f0c-dc2089e80f8f tempest-GroupSnapshotsTest-1368429301 None] Group tempest-GroupSnapshotsTest-Group-1552950793: creating Sep 17 23:42:28 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (f573b86e-20eb-4be9-82bb-7806ac3ee519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010b9eac-9293-4a75-9b16-e1de11191352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010b9eac-9293-4a75-9b16-e1de11191352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1565341697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a763b08-dab3-4563-8602-d5ada3df521f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:28Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30cbc13-edfa-4154-a8c0-422f41db800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30cbc13-edfa-4154-a8c0-422f41db800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d5fef6-f0d7-46b5-82a7-c0b248e6dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d5fef6-f0d7-46b5-82a7-c0b248e6dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a763b08-dab3-4563-8602-d5ada3df521f', 'volume_name': 'volume-7a763b08-dab3-4563-8602-d5ada3df521f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078ca0be-d854-4371-aae3-ee6c12a332d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078ca0be-d854-4371-aae3-ee6c12a332d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c9b4f5-8282-4005-aa41-5e0f4cd7763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:28 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Volume 7a763b08-dab3-4563-8602-d5ada3df521f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a763b08-dab3-4563-8602-d5ada3df521f', 'volume_size': 1} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1565341697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a763b08-dab3-4563-8602-d5ada3df521f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:28Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Creating volume 7a763b08-dab3-4563-8602-d5ada3df521f {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:28 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7019a6e9-ac2b-4319-9f0c-dc2089e80f8f tempest-GroupSnapshotsTest-1368429301 None] Group tempest-GroupSnapshotsTest-Group-1552950793: created successfully Sep 17 23:42:28 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f 1073741824 Sep 17 23:42:28 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7019a6e9-ac2b-4319-9f0c-dc2089e80f8f tempest-GroupSnapshotsTest-1368429301 None] Create group completed successfully. Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Attempting download of ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume e91fc92f-ea7b-4e46-a5ed-df942769d457. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d147319f-8047-447a-8ea9-6405346c4927]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uqii7812 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:28 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uqii7812 Sep 17 23:42:28 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:28 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f 1073741824" returned: 0 in 0.438s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:28 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uqii7812" returned: 0 in 0.370s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uqii7812 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:28 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f Sep 17 23:42:28 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:28 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uqii7812 Sep 17 23:42:28 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:29 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f" returned: 0 in 0.330s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c9b4f5-8282-4005-aa41-5e0f4cd7763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a763b08-dab3-4563-8602-d5ada3df521f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bab743-6244-47ef-9d66-b25773f093fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:29 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Volume volume-7a763b08-dab3-4563-8602-d5ada3df521f (7a763b08-dab3-4563-8602-d5ada3df521f): created successfully Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bab743-6244-47ef-9d66-b25773f093fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (f573b86e-20eb-4be9-82bb-7806ac3ee519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:29 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uqii7812" returned: 1 in 0.444s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uqii7812' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1942ec-4b90-426c-a3ba-55b3ddf0ab40]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:29 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d93e14d6-d730-421d-ad92-a53f7dd11074 tempest-VolumesActionsTest-749761007 None] Created volume successfully. Sep 17 23:42:29 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD Sep 17 23:42:29 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:29 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] ecf291a3-5fd0-40b6-8d63-9625bdc973ee was qcow2, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:29 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 Sep 17 23:42:29 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (ed07973f-cde2-4d8b-a5a7-86319849429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96315f5e-86c5-499e-942c-8042e47499f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96315f5e-86c5-499e-942c-8042e47499f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-633577377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b67ef3e4-b8dd-4fcb-8164-faa00b36f697,host='devstack@QuobyteHD#QuobyteHD',id=cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:30Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69369f66-4ddd-462e-bdd1-f4b4615beba9),volume_type_id=69369f66-4ddd-462e-bdd1-f4b4615beba9)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2305d3ba-42b1-4663-98a9-10dc63c3ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2305d3ba-42b1-4663-98a9-10dc63c3ff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9300d9-55c4-4a61-8411-a5578be80d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9300d9-55c4-4a61-8411-a5578be80d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d', 'volume_name': 'volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2458f2a-c582-4b79-a85b-4d97e3bf39f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2458f2a-c582-4b79-a85b-4d97e3bf39f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352382c5-4a01-4704-9f20-caa2bfb3a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:29 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Volume cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d', 'volume_size': 1} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b67ef3e4-b8dd-4fcb-8164-faa00b36f697,created_at=2026-09-17T21:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-633577377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b67ef3e4-b8dd-4fcb-8164-faa00b36f697,host='devstack@QuobyteHD#QuobyteHD',id=cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:30Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69369f66-4ddd-462e-bdd1-f4b4615beba9),volume_type_id=69369f66-4ddd-462e-bdd1-f4b4615beba9)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Creating volume cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:29 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:29 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d 1073741824 Sep 17 23:42:29 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-7a763b08-dab3-4563-8602-d5ada3df521f-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Lock "cinder-7a763b08-dab3-4563-8602-d5ada3df521f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Acquiring lock "cinder-quobyte-7a763b08-dab3-4563-8602-d5ada3df521f" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-7a763b08-dab3-4563-8602-d5ada3df521f" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b5b5f2-d98d-45c9-8229-bc86345f7458]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:30 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f Sep 17 23:42:30 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:30 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d 1073741824" returned: 0 in 0.708s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:30 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d Sep 17 23:42:30 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:30 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f" returned: 0 in 0.455s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:30 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f Sep 17 23:42:30 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:30 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" returned: 0 in 0.376s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352382c5-4a01-4704-9f20-caa2bfb3a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da3cce2-22dd-4839-aacc-b390c2621566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:31 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Volume volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d (cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d): created successfully Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da3cce2-22dd-4839-aacc-b390c2621566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (ed07973f-cde2-4d8b-a5a7-86319849429b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5387f5da-a453-4dc4-a6c0-3a96ae723aec tempest-GroupSnapshotsTest-1368429301 None] Created volume successfully. Sep 17 23:42:31 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7a763b08-dab3-4563-8602-d5ada3df521f" returned: 0 in 0.322s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Lock "cinder-quobyte-7a763b08-dab3-4563-8602-d5ada3df521f" released by "delete_volume" :: held 0.829s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Created reservations ['b4a3cfba-ebba-4e27-a622-7b2eb9ada4af', 'e0fe4f1d-c3e1-4f99-bdc5-da3ae43dd38d', '06bd4878-1f1d-40f7-ac1d-b88ead190d84', 'eef6186b-d028-4ac8-9c90-8bd27391f209'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:31 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:31 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:31 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Deleted volume successfully. Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ecf9765c-221b-4449-af2d-0f27f4b2f80f tempest-VolumesActionsTest-1501849670 None] Lock "cinder-7a763b08-dab3-4563-8602-d5ada3df521f-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:31 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457" returned: 0 in 2.368s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_6voxtqh0devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:42:31 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Converted 112.00 MB image at 47.29 MB/s Sep 17 23:42:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:32 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 1G Sep 17 23:42:32 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (b2459039-015b-4d7e-90d0-be98c22c2e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97514105-f5ae-4610-9ed4-a7e1de0daa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97514105-f5ae-4610-9ed4-a7e1de0daa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541042067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:32Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63718ed-1f14-482b-8a50-3be12ae32c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63718ed-1f14-482b-8a50-3be12ae32c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc1b544-c6d8-4ce1-ba98-f02a2f6d802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc1b544-c6d8-4ce1-ba98-f02a2f6d802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d', 'volume_name': 'volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55813223-f704-455a-8a36-1c91977d81c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55813223-f704-455a-8a36-1c91977d81c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de9cbfa-90a6-47a4-b66e-35dcf6f32037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:32 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Volume 95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d', 'volume_size': 1} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541042067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaebed57bba4eb6a68a931aeea1f4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:42:32Z,use_quota=True,user_id='8666fd3869cf407499b7f909ac160f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Creating volume 95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:32 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:32 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d 1073741824 Sep 17 23:42:32 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:32 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 1G" returned: 0 in 0.445s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Downloaded image ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume e91fc92f-ea7b-4e46-a5ed-df942769d457 successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee for user 14a1527fd97b4901bf5fb961af84a8be is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Marking volume e91fc92f-ea7b-4e46-a5ed-df942769d457 as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Copying metadata from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee to e91fc92f-ea7b-4e46-a5ed-df942769d457. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Creating volume glance metadata for volume e91fc92f-ea7b-4e46-a5ed-df942769d457 backed by image ecf291a3-5fd0-40b6-8d63-9625bdc973ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4973d0ab-3ac3-417e-875d-b0533a1b0dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91fc92f-ea7b-4e46-a5ed-df942769d457', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca43dbb-5245-4169-905f-a4804508b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:32 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Volume volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 (e91fc92f-ea7b-4e46-a5ed-df942769d457): created successfully Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca43dbb-5245-4169-905f-a4804508b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Flow 'volume_create_manager' (2eedf750-271c-4a6f-a05d-9460fcc5a88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-859dac54-8584-4f70-9017-8c1a324de039 tempest-ServerActionsTestOtherA-1324997458 None] Created volume successfully. Sep 17 23:42:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] GroupSnapshot 33827b40-1b68-4026-a17a-b9d003500e71: creating. Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Group snapshot 33827b40-1b68-4026-a17a-b9d003500e71: creating. {{(pid=85956) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:32 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d 1073741824" returned: 0 in 0.568s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:32 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d Sep 17 23:42:32 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:33 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.442s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de9cbfa-90a6-47a4-b66e-35dcf6f32037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9005bd-59d3-4b1e-82b8-43c94f8b47ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Creating offline snapshot 87ec6eb0-445f-4d6d-b716-d6dc76669eb1 of volume cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:42:33 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Volume volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d (95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d): created successfully Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9005bd-59d3-4b1e-82b8-43c94f8b47ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Flow 'volume_create_manager' (b2459039-015b-4d7e-90d0-be98c22c2e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be2878-5dd5-4c4a-b71c-db6e0ab79c3c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-47ab7b39-cf1a-497c-8ec4-8d19a9744106 tempest-VolumesActionsTest-749761007 None] Created volume successfully. Sep 17 23:42:33 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d Sep 17 23:42:33 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:33 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" returned: 0 in 0.401s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:33 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 1G Sep 17 23:42:33 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:34 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 1G" returned: 0 in 0.467s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:34 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 Sep 17 23:42:34 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:34 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1" returned: 0 in 0.351s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:34 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:42:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:34 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 Sep 17 23:42:34 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:34 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1" returned: 0 in 0.370s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:34 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.info Sep 17 23:42:34 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Acquiring lock "cinder-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Lock "cinder-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Acquiring lock "cinder-quobyte-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Lock "cinder-quobyte-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b5f586-e8e4-4815-897c-3e3c355ed3e7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:35 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.info" returned: 0 in 0.453s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:35 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:35 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.info Sep 17 23:42:35 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:35 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d Sep 17 23:42:35 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:35 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.info" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dfb8f5ea-e31b-4262-8dfe-2c89d66fa28d tempest-GroupSnapshotsTest-1368429301 None] group_snapshot 33827b40-1b68-4026-a17a-b9d003500e71: created successfully Sep 17 23:42:35 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d" returned: 0 in 0.466s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:35 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d Sep 17 23:42:35 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:36 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d" returned: 0 in 0.335s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Lock "cinder-quobyte-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d" released by "delete_volume" :: held 0.857s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Created reservations ['7b75384a-6f5b-4df5-b2e6-91e3307d57bb', '9414e309-6426-4b60-9a65-ab21e3dc4867', '574bb36c-9e77-415c-9af4-21daec653fdf', 'aca3b916-d333-4e6b-9fdc-5572e6761b50'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:36 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:36 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:36 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.274s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Deleted volume successfully. Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b997bfd4-9752-4097-bc4c-359668bad5ed tempest-VolumesActionsTest-749761007 None] Lock "cinder-95cc0e15-ad4e-4115-9d2a-1d9b7be3ba3d-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-72d539c5-3ca2-4707-b599-a7464948c282 req-65d53dc8-434d-4aaf-bb93-f34915258517 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-72d539c5-3ca2-4707-b599-a7464948c282 req-65d53dc8-434d-4aaf-bb93-f34915258517 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-72d539c5-3ca2-4707-b599-a7464948c282 req-65d53dc8-434d-4aaf-bb93-f34915258517 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-72d539c5-3ca2-4707-b599-a7464948c282 req-65d53dc8-434d-4aaf-bb93-f34915258517 tempest-ServerActionsTestOtherA-1324997458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-e91fc92f-ea7b-4e46-a5ed-df942769d457', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25715fd8-9d9d-4602-9604-0bd41a885f6d', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:42:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-72d539c5-3ca2-4707-b599-a7464948c282 req-65d53dc8-434d-4aaf-bb93-f34915258517 tempest-ServerActionsTestOtherA-1324997458 None] attachment_update completed successfully. Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-87ec6eb0-445f-4d6d-b716-d6dc76669eb1-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-87ec6eb0-445f-4d6d-b716-d6dc76669eb1-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Creating volume a5bf22e2-73e7-4ae2-b0ac-312693e98c47 from snapshot 87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] snapshot: 87ec6eb0-445f-4d6d-b716-d6dc76669eb1, volume: a5bf22e2-73e7-4ae2-b0ac-312693e98c47, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7a6f9-db24-4c22-b5ef-31136bd36dc5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:37 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 Sep 17 23:42:37 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:37 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1" returned: 0 in 0.539s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d369f2-8d72-40b6-acfa-5c991cf4d93c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:37 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d Sep 17 23:42:37 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:38 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" returned: 0 in 0.510s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:42:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:42:38 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:42:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:38 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 Sep 17 23:42:38 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:42:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:42 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:42 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:43 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.835s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:43 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:46 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=98,cinder:INSERT=29,cinder:UPDATE=108,cinder:DELETE=7 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:42:47 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=105,cinder:UPDATE=109,cinder:DELETE=12,cinder:INSERT=30 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:42:49 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" returned: 0 in 11.342s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:49 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d, size 1024.00 MB, duration 11.34 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:42:49 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Converted 1024.00 MB image at 90.27 MB/s Sep 17 23:42:49 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:42:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:49 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 Sep 17 23:42:49 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:49 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" returned: 0 in 0.333s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" released by "_copy_volume_from_snapshot" :: held 12.887s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-87ec6eb0-445f-4d6d-b716-d6dc76669eb1-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" released by "_create_volume_from_snapshot" :: held 12.987s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.026s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:50 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5a55d7da-3c85-4fef-b9bd-b0cfb4508d2b tempest-GroupSnapshotsTest-1368429301 None] Create group from source-snapshot-33827b40-1b68-4026-a17a-b9d003500e71 completed successfully. Sep 17 23:42:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" acquired by "delete_volume" :: waited 0.044s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:52 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b956e6-5f8e-42cd-93b3-583e494c9e44]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:52 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 Sep 17 23:42:52 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:52 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" returned: 0 in 0.621s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:52 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47 Sep 17 23:42:52 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:53 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" returned: 0 in 0.442s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-a5bf22e2-73e7-4ae2-b0ac-312693e98c47" released by "delete_volume" :: held 1.152s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['aa95500d-3b55-4239-8c80-df430f7b04c7'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:53 devstack cinder-volume[85956]: WARNING cinder.quota [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1291630081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1291630081, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:42:53 devstack cinder-volume[85956]: WARNING cinder.quota [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1291630081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1291630081, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['eb2f2183-883d-47ff-b6f8-75d454e05703', 'ac1bd4ae-c7e3-48a8-aaee-767e985a3ec8', '8fdf67c2-121e-4cb2-a37a-977ddd180262', '88b4c7d1-3801-47c5-abcc-11455f4d47ad'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:53 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:42:53 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:53 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.339s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:53 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:42:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f38fe1f8-4e6f-4091-85b3-0c6c43a8c8b1 tempest-GroupSnapshotsTest-1368429301 None] Delete group completed successfully. Sep 17 23:42:54 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] group_snapshot 33827b40-1b68-4026-a17a-b9d003500e71: deleting Sep 17 23:42:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] group_snapshot 33827b40-1b68-4026-a17a-b9d003500e71: deleting {{(pid=85956) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 23:42:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-87ec6eb0-445f-4d6d-b716-d6dc76669eb1" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-87ec6eb0-445f-4d6d-b716-d6dc76669eb1" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Deleting offline snapshot 87ec6eb0-445f-4d6d-b716-d6dc76669eb1 of volume cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] snapshot_file for this snap is: volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df723cb-573f-4d2b-933f-be2c920dfa5a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:55 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 Sep 17 23:42:55 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:55 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-ddc4421e-b796-421e-a6d1-be8600487a8b req-93ecee8a-5759-4ac8-b16c-0aae678b7fec tempest-AttachVolumeNegativeTest-1295557150 None] Terminate volume connection completed successfully. Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-ddc4421e-b796-421e-a6d1-be8600487a8b req-93ecee8a-5759-4ac8-b16c-0aae678b7fec tempest-AttachVolumeNegativeTest-1295557150 None] Deleting attachment 70edd3af-58b8-48ce-953d-7a7605a52ac6. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:42:55 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1" returned: 0 in 0.724s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b11b1c-1555-46d3-bfeb-f9050d38ab8b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:42:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:56 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d Sep 17 23:42:56 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:57 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" returned: 0 in 1.199s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:57 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 Sep 17 23:42:57 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:58 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1" returned: 0 in 0.903s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:42:58 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1 Sep 17 23:42:58 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:42:58 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Sep 17 23:42:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d.87ec6eb0-445f-4d6d-b716-d6dc76669eb1" returned: 0 in 0.468s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:42:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-87ec6eb0-445f-4d6d-b716-d6dc76669eb1" released by "_delete_snapshot" :: held 3.573s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" released by "delete_snapshot" :: held 3.652s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:42:58 devstack cinder-volume[85956]: WARNING cinder.quota [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1291630081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1291630081, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:42:58 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['23f23646-85b0-466a-9156-e6ca2bcd8d0a', '07daf24d-3404-4462-b5c2-688d055c3106', 'c879b8f5-5a5f-47ec-9ee9-4b5c268d2015', 'a4f52d19-475d-4730-a4e5-5b0b974c6a9f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:42:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-64626dce-8cea-46fd-8711-b732e0f57846 tempest-GroupSnapshotsTest-1368429301 None] group_snapshot 33827b40-1b68-4026-a17a-b9d003500e71: deleted successfully Sep 17 23:43:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad12efb-ce63-4b0f-a891-97a78efc6881]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:00 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d Sep 17 23:43:00 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:01 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" returned: 0 in 0.837s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:01 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d Sep 17 23:43:01 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:01 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" returned: 0 in 0.470s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-cf2851a5-2bdd-4dc3-b9c9-a8a076d60a2d" released by "delete_volume" :: held 1.451s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:01 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['7f34c307-5ab4-4f22-8623-87a259c9a32c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:01 devstack cinder-volume[85956]: WARNING cinder.db.api [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1291630081'] Sep 17 23:43:01 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['b176aa3d-5760-4ae8-829b-5af8e01e42bf', 'e8042c6a-d060-4e8e-bc65-c8b5f1ba73f6', '0640f453-6ec4-4a53-a0c1-bf7943556d7b', '5d8c7670-561b-4ce6-a9a0-fce0b7977dfe'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:02 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:02 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:02 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.500s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:02 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4ba83d94-d2d7-4aee-b2ae-10f568a14774 tempest-GroupSnapshotsTest-1368429301 None] Delete group completed successfully. Sep 17 23:43:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-312d7c8f-c14a-4eba-87eb-5ae4decdddc1 tempest-GroupSnapshotsTest-1368429301 None] Group tempest-GroupSnapshotsTest-Group-492857899: creating Sep 17 23:43:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-312d7c8f-c14a-4eba-87eb-5ae4decdddc1 tempest-GroupSnapshotsTest-1368429301 None] Group tempest-GroupSnapshotsTest-Group-492857899: created successfully Sep 17 23:43:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-312d7c8f-c14a-4eba-87eb-5ae4decdddc1 tempest-GroupSnapshotsTest-1368429301 None] Create group completed successfully. Sep 17 23:43:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-cf35d4a8-817f-4e7b-8e9b-238ae9e0581c req-94544cf9-531a-494a-b9b8-a9870dcc5543 tempest-ServerActionsTestOtherA-1324997458 None] Terminate volume connection completed successfully. Sep 17 23:43:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-cf35d4a8-817f-4e7b-8e9b-238ae9e0581c req-94544cf9-531a-494a-b9b8-a9870dcc5543 tempest-ServerActionsTestOtherA-1324997458 None] Deleting attachment 25715fd8-9d9d-4602-9604-0bd41a885f6d. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (215f88c4-9622-4fb5-84cf-25508d560b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779937a5-96ac-4d2a-b66b-188ca241c8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779937a5-96ac-4d2a-b66b-188ca241c8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289659743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dbe3dee-2a61-4d0b-90b0-381a0f7a06aa,host='devstack@QuobyteHD#QuobyteHD',id=e8be4f99-13c8-4165-bc72-8e989c1d1c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:06Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b802345-fc6d-481b-b6ef-b10e5d7405ae),volume_type_id=5b802345-fc6d-481b-b6ef-b10e5d7405ae)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112277de-8137-4785-80d6-a167d1b3b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112277de-8137-4785-80d6-a167d1b3b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c08daf-e40d-4f78-bf28-e94368f94156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c08daf-e40d-4f78-bf28-e94368f94156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8be4f99-13c8-4165-bc72-8e989c1d1c7a', 'volume_name': 'volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db673e2-9ad8-42b3-84e7-963fffea8a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db673e2-9ad8-42b3-84e7-963fffea8a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def0a04b-62b7-47a0-b47b-f58ea6a6ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:06 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Volume e8be4f99-13c8-4165-bc72-8e989c1d1c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a', 'volume_size': 1} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3dbe3dee-2a61-4d0b-90b0-381a0f7a06aa,created_at=2026-09-17T21:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289659743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dbe3dee-2a61-4d0b-90b0-381a0f7a06aa,host='devstack@QuobyteHD#QuobyteHD',id=e8be4f99-13c8-4165-bc72-8e989c1d1c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:06Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b802345-fc6d-481b-b6ef-b10e5d7405ae),volume_type_id=5b802345-fc6d-481b-b6ef-b10e5d7405ae)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Creating volume e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:06 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:06 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a 1073741824 Sep 17 23:43:06 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:06 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a 1073741824" returned: 0 in 0.557s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:06 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a Sep 17 23:43:06 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:07 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:43:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def0a04b-62b7-47a0-b47b-f58ea6a6ea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4649c1e-41f0-461c-8b12-7f45bef3b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:07 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Volume volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a (e8be4f99-13c8-4165-bc72-8e989c1d1c7a): created successfully Sep 17 23:43:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4649c1e-41f0-461c-8b12-7f45bef3b833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (215f88c4-9622-4fb5-84cf-25508d560b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:07 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d4511db5-9e93-41b7-b2a3-b7dae70644b7 tempest-GroupSnapshotsTest-1368429301 None] Created volume successfully. Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (a15efff7-9fe3-456c-9f4b-2cc4a5adbc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea7e7ec-7345-48cc-9173-e3dd4c3e0c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea7e7ec-7345-48cc-9173-e3dd4c3e0c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-125164736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dbe3dee-2a61-4d0b-90b0-381a0f7a06aa,host='devstack@QuobyteHD#QuobyteHD',id=29a4b59a-1bcb-45ba-b51b-0e6da24446a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:08Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b802345-fc6d-481b-b6ef-b10e5d7405ae),volume_type_id=5b802345-fc6d-481b-b6ef-b10e5d7405ae)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535c4649-2dae-40ed-b4df-f128168858bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535c4649-2dae-40ed-b4df-f128168858bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488a7e37-bd7e-43ed-b053-9950e8e9a4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488a7e37-bd7e-43ed-b053-9950e8e9a4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a4b59a-1bcb-45ba-b51b-0e6da24446a9', 'volume_name': 'volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4536b9-cefa-4c5f-87b8-f93f6c7239b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4536b9-cefa-4c5f-87b8-f93f6c7239b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2589e12-e367-47de-9ef2-3afd25b689e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:08 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Volume 29a4b59a-1bcb-45ba-b51b-0e6da24446a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9', 'volume_size': 1} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3dbe3dee-2a61-4d0b-90b0-381a0f7a06aa,created_at=2026-09-17T21:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-125164736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dbe3dee-2a61-4d0b-90b0-381a0f7a06aa,host='devstack@QuobyteHD#QuobyteHD',id=29a4b59a-1bcb-45ba-b51b-0e6da24446a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:08Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b802345-fc6d-481b-b6ef-b10e5d7405ae),volume_type_id=5b802345-fc6d-481b-b6ef-b10e5d7405ae)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Creating volume 29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:08 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:08 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 1073741824 Sep 17 23:43:08 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-cf35d4a8-817f-4e7b-8e9b-238ae9e0581c req-0b851691-7945-4123-9e69-3271c21f4af5 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:09 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 1073741824" returned: 0 in 0.866s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:09 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 Sep 17 23:43:09 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:09 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" returned: 0 in 0.279s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-cf35d4a8-817f-4e7b-8e9b-238ae9e0581c req-0b851691-7945-4123-9e69-3271c21f4af5 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.721s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2589e12-e367-47de-9ef2-3afd25b689e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f7b069-cf4e-4c60-ab17-86b4446b6f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-cf35d4a8-817f-4e7b-8e9b-238ae9e0581c req-0b851691-7945-4123-9e69-3271c21f4af5 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:09 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Volume volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 (29a4b59a-1bcb-45ba-b51b-0e6da24446a9): created successfully Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f7b069-cf4e-4c60-ab17-86b4446b6f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (a15efff7-9fe3-456c-9f4b-2cc4a5adbc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-cf35d4a8-817f-4e7b-8e9b-238ae9e0581c req-0b851691-7945-4123-9e69-3271c21f4af5 tempest-ServerActionsTestOtherA-1324997458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-e91fc92f-ea7b-4e46-a5ed-df942769d457', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03abf4d6-2ba3-4d7f-b93f-29b726ec1d06', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:43:09 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-798dd4a0-6fd4-4839-bbd4-15e22775c199 tempest-GroupSnapshotsTest-1368429301 None] Created volume successfully. Sep 17 23:43:09 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-cf35d4a8-817f-4e7b-8e9b-238ae9e0581c req-0b851691-7945-4123-9e69-3271c21f4af5 tempest-ServerActionsTestOtherA-1324997458 None] attachment_update completed successfully. Sep 17 23:43:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e362d6e0-6d32-4286-9cea-d199393600f6 tempest-GroupSnapshotsTest-1368429301 None] Update group completed successfully. Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Flow 'volume_create_manager' (3d0955a2-97c1-4494-8689-870895fc6fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cc5ec5-1659-4083-834d-3feae30d309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cc5ec5-1659-4083-834d-3feae30d309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1332036448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae37af7bbfe7476496b3466b58971f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:12Z,use_quota=True,user_id='b21101519c6343f48d9d25fb6c30d770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4995be11-e80f-41e7-92c0-914050ee82ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4995be11-e80f-41e7-92c0-914050ee82ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ff5012-b3e3-4359-a7b3-f253df48a6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ff5012-b3e3-4359-a7b3-f253df48a6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8', 'volume_name': 'volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef07c14-77b4-4f69-85b2-7939ecb090e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef07c14-77b4-4f69-85b2-7939ecb090e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2864da4f-8628-4afe-b2c8-7514723cb5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Volume 49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8', 'volume_size': 1} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1332036448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae37af7bbfe7476496b3466b58971f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:12Z,use_quota=True,user_id='b21101519c6343f48d9d25fb6c30d770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Creating volume 49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:12 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:12 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 1073741824 Sep 17 23:43:12 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-39e4c44b-d5b0-41d3-a5e9-730094a13d59 tempest-GroupSnapshotsTest-1368429301 None] Update group completed successfully. Sep 17 23:43:12 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 1073741824" returned: 0 in 0.811s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:12 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 Sep 17 23:43:12 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:13 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" returned: 0 in 0.376s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:43:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2864da4f-8628-4afe-b2c8-7514723cb5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3799d4cd-c887-4222-8489-fc12828a623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Volume volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 (49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8): created successfully Sep 17 23:43:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3799d4cd-c887-4222-8489-fc12828a623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Flow 'volume_create_manager' (3d0955a2-97c1-4494-8689-870895fc6fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:13 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6d609996-8121-44fd-a718-986f5e48b8e7 tempest-SnapshotMetadataTestJSON-1796815717 None] Created volume successfully. Sep 17 23:43:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d7e2e94d-7f9a-4fef-86a5-79f559652a8d tempest-GroupSnapshotsTest-1368429301 None] Update group completed successfully. Sep 17 23:43:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Creating offline snapshot af0be2bb-2031-4e22-af24-8cdb7864a18c of volume 49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:43:14 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d6c24-eeb5-4cc8-be6e-2172be8be187]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:14 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 Sep 17 23:43:14 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:15 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-81ddcadf-8ea8-48cc-b19e-4dd2d6c88dd2 tempest-GroupSnapshotsTest-1368429301 None] Update group completed successfully. Sep 17 23:43:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" returned: 0 in 0.724s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:15 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c 1G Sep 17 23:43:15 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:16 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c 1G" returned: 0 in 0.667s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:16 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c Sep 17 23:43:16 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:16 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c" returned: 0 in 0.771s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:16 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c is being set with open permissions: ugo+rw Sep 17 23:43:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:17 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c Sep 17 23:43:17 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:17 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c" returned: 0 in 0.792s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:17 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.info Sep 17 23:43:17 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:18 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] GroupSnapshot ab499a19-c92d-44bf-8b37-658db5a2e6dc: creating. Sep 17 23:43:18 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.info" returned: 0 in 0.848s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:18 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.info is being set with open permissions: ugo+rw Sep 17 23:43:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:18 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.info Sep 17 23:43:18 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Group snapshot ab499a19-c92d-44bf-8b37-658db5a2e6dc: creating. {{(pid=85956) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 23:43:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:19 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.info" returned: 0 in 0.762s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.756s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.686s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Creating offline snapshot c5066b32-c14c-42e4-98ac-ea656d39e25d of volume e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:43:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6dee3e2d-fdc5-4960-b68f-e982027e3ee9 tempest-SnapshotMetadataTestJSON-1796815717 None] Create snapshot completed successfully Sep 17 23:43:19 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae42e9-e896-4150-9dcd-d1571632d69b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:19 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a Sep 17 23:43:19 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:20 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" returned: 0 in 0.827s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:20 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d 1G Sep 17 23:43:20 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:21 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d 1G" returned: 0 in 0.585s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:21 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d Sep 17 23:43:21 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "cinder-af0be2bb-2031-4e22-af24-8cdb7864a18c-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-af0be2bb-2031-4e22-af24-8cdb7864a18c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "cinder-quobyte-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-quobyte-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "cinder-quobyte-af0be2bb-2031-4e22-af24-8cdb7864a18c" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:21 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d" returned: 0 in 0.630s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:21 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-quobyte-af0be2bb-2031-4e22-af24-8cdb7864a18c" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Deleting offline snapshot af0be2bb-2031-4e22-af24-8cdb7864a18c of volume 49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:43:21 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d Sep 17 23:43:21 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] snapshot_file for this snap is: volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[489414fb-08fa-4c56-8fc3-002d4f3890ca]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:21 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c Sep 17 23:43:21 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:22 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d" returned: 0 in 0.509s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:22 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.info Sep 17 23:43:22 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:22 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c" returned: 0 in 0.581s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2dacec-d722-4260-80e1-b8061fa208f6]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:22 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.info" returned: 0 in 0.343s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:22 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:43:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:22 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 Sep 17 23:43:22 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:22 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.info Sep 17 23:43:22 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:23 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.info" returned: 0 in 0.568s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.699s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:23 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" returned: 0 in 0.803s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Creating offline snapshot f8c52015-3aee-4501-a209-5ffbdd7abcda of volume 29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c553c35b-9071-41bb-a805-699f11814673]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:23 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c Sep 17 23:43:23 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:23 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 Sep 17 23:43:23 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:23 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c" returned: 0 in 0.714s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:23 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c Sep 17 23:43:23 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:24 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" returned: 0 in 0.793s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:24 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda 1G Sep 17 23:43:24 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:24 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8.af0be2bb-2031-4e22-af24-8cdb7864a18c" returned: 0 in 0.462s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-quobyte-af0be2bb-2031-4e22-af24-8cdb7864a18c" released by "_delete_snapshot" :: held 2.747s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-quobyte-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" released by "delete_snapshot" :: held 2.829s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Created reservations ['6f308a86-6419-4606-a322-2114a0620fe2', '0e0246c7-60c4-4b7a-a2d9-575ede01c40e', 'fb5f8b37-44a8-4b17-8a36-da714e8e977d', 'f44074a3-b934-42ba-82e4-d606395efe6a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Delete snapshot completed successfully. Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-69f15a7e-1961-4af5-9d88-df82adf783ff tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-af0be2bb-2031-4e22-af24-8cdb7864a18c-delete_snapshot" released by "delete_snapshot" :: held 3.077s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:24 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda 1G" returned: 0 in 0.729s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:24 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda Sep 17 23:43:24 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "cinder-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "cinder-quobyte-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-quobyte-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9706b2e-9274-435b-9e92-91523ae5fdda]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:25 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda" returned: 0 in 0.493s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:25 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:25 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 Sep 17 23:43:25 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:25 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda Sep 17 23:43:25 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:25 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:25 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" returned: 0 in 0.415s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:25 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.info Sep 17 23:43:25 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:25 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8 Sep 17 23:43:25 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:25 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" returned: 0 in 0.287s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-quobyte-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8" released by "delete_volume" :: held 0.780s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:25 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.info" returned: 0 in 0.389s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:25 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:43:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Created reservations ['908a7834-128c-469b-92a2-bf1d04ba75bc', '156c7409-4351-4e62-b185-02738cf19289', 'a1f3b3d8-7e22-4ce7-a273-68c54f1829c9', '32c8678f-28e6-472c-a8d3-03973c39d894'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:26 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.info Sep 17 23:43:26 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:26 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:26 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:26 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.info" returned: 0 in 0.424s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.262s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:26 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Deleted volume successfully. Sep 17 23:43:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56210a33-5c92-4dbc-b488-3513d10ab9a6 tempest-SnapshotMetadataTestJSON-1796815717 None] Lock "cinder-49cfa2a8-60d5-4425-b74a-8e6e0fc85bb8-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0716cd14-2809-4dbc-8b36-feb581a4ec6f tempest-GroupSnapshotsTest-1368429301 None] group_snapshot ab499a19-c92d-44bf-8b37-658db5a2e6dc: created successfully Sep 17 23:43:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] group_snapshot ab499a19-c92d-44bf-8b37-658db5a2e6dc: deleting Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] group_snapshot ab499a19-c92d-44bf-8b37-658db5a2e6dc: deleting {{(pid=85956) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-c5066b32-c14c-42e4-98ac-ea656d39e25d" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-c5066b32-c14c-42e4-98ac-ea656d39e25d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Deleting offline snapshot c5066b32-c14c-42e4-98ac-ea656d39e25d of volume e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] snapshot_file for this snap is: volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c8fb7-d0f5-40fe-846a-e4e14a86ff6b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:28 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d Sep 17 23:43:28 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:28 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d" returned: 0 in 0.566s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a9d0f-99a9-4564-8a3a-a2bb27847c80]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:28 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a Sep 17 23:43:28 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:28 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" returned: 0 in 0.450s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:28 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d Sep 17 23:43:28 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:29 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d" returned: 0 in 0.423s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:29 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d Sep 17 23:43:29 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:29 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a.c5066b32-c14c-42e4-98ac-ea656d39e25d" returned: 0 in 0.307s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-c5066b32-c14c-42e4-98ac-ea656d39e25d" released by "_delete_snapshot" :: held 1.935s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" released by "delete_snapshot" :: held 1.978s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-f8c52015-3aee-4501-a209-5ffbdd7abcda" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-f8c52015-3aee-4501-a209-5ffbdd7abcda" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Deleting offline snapshot f8c52015-3aee-4501-a209-5ffbdd7abcda of volume 29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] snapshot_file for this snap is: volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f4df6c-444a-49c8-a32c-d346e8342a18]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:30 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda Sep 17 23:43:30 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:30 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda" returned: 0 in 0.640s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:30 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe5b94-000b-4a66-be8d-287134986c5d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:30 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 Sep 17 23:43:30 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:31 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" returned: 0 in 0.489s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:31 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda Sep 17 23:43:31 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:31 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda" returned: 0 in 0.457s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:31 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda Sep 17 23:43:31 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:31 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9.f8c52015-3aee-4501-a209-5ffbdd7abcda" returned: 0 in 0.300s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-f8c52015-3aee-4501-a209-5ffbdd7abcda" released by "_delete_snapshot" :: held 2.031s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" released by "delete_snapshot" :: held 2.069s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:31 devstack cinder-volume[85956]: WARNING cinder.quota [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-79982390 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-79982390, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:43:31 devstack cinder-volume[85956]: WARNING cinder.quota [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-79982390 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-79982390, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:43:31 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['62238917-fa7f-4c96-b588-3199d9871b16', '69a40b71-2030-4f62-ab85-97d1dcc8b516', 'b281e146-39c3-488f-95b1-e27dda8a060a', '8f4cc3b7-7dad-4db9-9ab2-7be5809e8b49'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['dd3a4009-9504-4702-9d40-18e66910d0ee', 'cf550f44-fdfb-48e2-a894-06924fd7178e', 'f82306c1-3666-4972-a6dc-94bca3634bae', 'bcd93e96-d7ce-4f71-bd01-1721cb2c040d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9bd6f40b-042b-4346-8605-c15ab6e42d7d tempest-GroupSnapshotsTest-1368429301 None] group_snapshot ab499a19-c92d-44bf-8b37-658db5a2e6dc: deleted successfully Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Flow 'volume_create_manager' (1f8ad2ef-8720-4d44-90dc-bc3e0e36766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebafaf44-59a3-4ee9-95ba-e3df612101e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebafaf44-59a3-4ee9-95ba-e3df612101e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1535191425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6765fd68-67db-4390-8563-1a8261237b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774422430e334dd5b59de21f6b869844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:32Z,use_quota=True,user_id='88bcca7281214a4ab8269b004057b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6761b567-a67b-4fa0-9cf1-f228c03ba72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6761b567-a67b-4fa0-9cf1-f228c03ba72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dd6dc5-2afd-4a82-836f-3a6ef4be1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dd6dc5-2afd-4a82-836f-3a6ef4be1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6765fd68-67db-4390-8563-1a8261237b4a', 'volume_name': 'volume-6765fd68-67db-4390-8563-1a8261237b4a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79516db1-aeb1-4ae3-82ed-b1f4413f17e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79516db1-aeb1-4ae3-82ed-b1f4413f17e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d12f9f-d1f3-4203-9b09-21f5f50f6107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:32 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Volume 6765fd68-67db-4390-8563-1a8261237b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6765fd68-67db-4390-8563-1a8261237b4a', 'volume_size': 1} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1535191425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6765fd68-67db-4390-8563-1a8261237b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774422430e334dd5b59de21f6b869844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:32Z,use_quota=True,user_id='88bcca7281214a4ab8269b004057b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Creating volume 6765fd68-67db-4390-8563-1a8261237b4a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:32 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:32 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a 1073741824 Sep 17 23:43:32 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8f25e8-c9da-4484-b2ab-12166b43eae2]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:33 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 Sep 17 23:43:33 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:33 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a 1073741824" returned: 0 in 0.550s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:33 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a Sep 17 23:43:33 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:33 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" returned: 0 in 0.450s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:33 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9 Sep 17 23:43:33 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:33 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a" returned: 0 in 0.298s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d12f9f-d1f3-4203-9b09-21f5f50f6107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6765fd68-67db-4390-8563-1a8261237b4a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fae53f7-891b-4c62-9bf1-9134dd1a12f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:33 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Volume volume-6765fd68-67db-4390-8563-1a8261237b4a (6765fd68-67db-4390-8563-1a8261237b4a): created successfully Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fae53f7-891b-4c62-9bf1-9134dd1a12f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Flow 'volume_create_manager' (1f8ad2ef-8720-4d44-90dc-bc3e0e36766f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6cfb1565-c1c4-4dda-b650-1de390d35c74 tempest-AbsoluteLimitsTests-2012632386 None] Created volume successfully. Sep 17 23:43:33 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" returned: 0 in 0.277s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-29a4b59a-1bcb-45ba-b51b-0e6da24446a9" released by "delete_volume" :: held 0.804s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" acquired by "delete_volume" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e25c0c-b14e-479c-85ff-c851458baa7d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:33 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a Sep 17 23:43:33 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:34 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" returned: 0 in 0.375s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:34 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a Sep 17 23:43:34 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:34 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" returned: 0 in 0.259s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-e8be4f99-13c8-4165-bc72-8e989c1d1c7a" released by "delete_volume" :: held 0.701s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['120527d1-6737-40e6-96eb-51395a0211f0'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:34 devstack cinder-volume[85956]: WARNING cinder.quota [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-79982390 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-79982390, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['c29a79a0-7994-4bd6-994f-4caae94424b9', '0b1935e2-1586-4ec9-b68a-3516c02c528b', '573c9096-4bf3-4e4c-84d5-07c39c40b729', 'ef8fe599-ec38-4421-a6ee-cf873fb66cdf'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['66be1ec9-4a61-4974-8cb5-8fa5ef3042a3', 'cf93f3de-a3e9-4f74-a435-0a4f8bec1712', '3dc5c9da-db5a-4d91-b7fd-f5effbb21d51', '96fc94d4-27f3-4430-ae78-f84764213417'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Acquiring lock "cinder-6765fd68-67db-4390-8563-1a8261237b4a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Lock "cinder-6765fd68-67db-4390-8563-1a8261237b4a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Acquiring lock "cinder-quobyte-6765fd68-67db-4390-8563-1a8261237b4a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Lock "cinder-quobyte-6765fd68-67db-4390-8563-1a8261237b4a" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:34 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:34 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdd4621-d596-47b1-bbc7-700bec3efba3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:34 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a Sep 17 23:43:34 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:34 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.261s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:34 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5843f0eb-a14a-4880-aded-7fb252eb602d tempest-GroupSnapshotsTest-1368429301 None] Delete group completed successfully. Sep 17 23:43:35 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a" returned: 0 in 0.364s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:35 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a Sep 17 23:43:35 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:35 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6765fd68-67db-4390-8563-1a8261237b4a" returned: 0 in 0.257s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Lock "cinder-quobyte-6765fd68-67db-4390-8563-1a8261237b4a" released by "delete_volume" :: held 0.667s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Created reservations ['8d3f9375-eb68-402d-bece-d7e268152958', '8952466d-979b-4c6c-ab97-bac070c3de7d', 'bb0ee188-25ce-4f63-8926-d477235a55b3', '73916155-580c-4eb3-b07c-211cb0f35783'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:35 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:35 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d1398e5a-bbc9-4b0b-b520-938a183292be tempest-GroupSnapshotsTest-1368429301 None] Group tempest-GroupSnapshotsTest-Group-445893217: creating Sep 17 23:43:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d1398e5a-bbc9-4b0b-b520-938a183292be tempest-GroupSnapshotsTest-1368429301 None] Group tempest-GroupSnapshotsTest-Group-445893217: created successfully Sep 17 23:43:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d1398e5a-bbc9-4b0b-b520-938a183292be tempest-GroupSnapshotsTest-1368429301 None] Create group completed successfully. Sep 17 23:43:35 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.252s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Deleted volume successfully. Sep 17 23:43:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c564a07-057a-4825-a40d-3bdc3346cc8f tempest-AbsoluteLimitsTests-2012632386 None] Lock "cinder-6765fd68-67db-4390-8563-1a8261237b4a-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (05d71ff2-fb73-48b4-a5be-dd8df4ee5c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5aab9d-660c-40f8-a723-ba829c136e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5aab9d-660c-40f8-a723-ba829c136e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903664390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55ad5831-fdcc-4917-ad05-d7849846ccd1,host='devstack@QuobyteHD#QuobyteHD',id=00f8f2dd-3ae8-497b-9225-9549cf0491ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:37Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdac1cbf-17a1-4304-bf7e-92e79332669e),volume_type_id=cdac1cbf-17a1-4304-bf7e-92e79332669e)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6ce51d-0c75-4ff0-a2b0-d6fb1beceab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6ce51d-0c75-4ff0-a2b0-d6fb1beceab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db8b83-eb90-4d59-814f-5faae533c020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db8b83-eb90-4d59-814f-5faae533c020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f8f2dd-3ae8-497b-9225-9549cf0491ad', 'volume_name': 'volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7ed4be-8d9c-47c7-806d-b588c077e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7ed4be-8d9c-47c7-806d-b588c077e502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9a96fb-95f1-439a-b39d-9d1cd2be8610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:37 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Volume 00f8f2dd-3ae8-497b-9225-9549cf0491ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad', 'volume_size': 1} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55ad5831-fdcc-4917-ad05-d7849846ccd1,created_at=2026-09-17T21:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903664390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55ad5831-fdcc-4917-ad05-d7849846ccd1,host='devstack@QuobyteHD#QuobyteHD',id=00f8f2dd-3ae8-497b-9225-9549cf0491ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f02e046ff14cb5ae1840bb9995ee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:37Z,use_quota=True,user_id='e4325e419bf746f9971c9dd3f979c21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdac1cbf-17a1-4304-bf7e-92e79332669e),volume_type_id=cdac1cbf-17a1-4304-bf7e-92e79332669e)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Creating volume 00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:37 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:37 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad 1073741824 Sep 17 23:43:37 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:37 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad 1073741824" returned: 0 in 0.469s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:37 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad Sep 17 23:43:37 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:38 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad" returned: 0 in 0.311s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9a96fb-95f1-439a-b39d-9d1cd2be8610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f29e82-a0ff-4068-8be0-f7c446340edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:38 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Volume volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad (00f8f2dd-3ae8-497b-9225-9549cf0491ad): created successfully Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f29e82-a0ff-4068-8be0-f7c446340edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Flow 'volume_create_manager' (05d71ff2-fb73-48b4-a5be-dd8df4ee5c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e5e3e6e9-f3c8-484c-8ee2-93a3af910d31 tempest-GroupSnapshotsTest-1368429301 None] Created volume successfully. Sep 17 23:43:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] GroupSnapshot bf092154-5b7d-4ee4-9dbd-ded9a6a111e4: creating. Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Group snapshot bf092154-5b7d-4ee4-9dbd-ded9a6a111e4: creating. {{(pid=85956) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Creating offline snapshot 70cc3a9f-293c-467e-aea2-c453b3d0d608 of volume 00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[016918f0-5cf1-4d30-a326-04ecccd3fd2d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:39 devstack sudo[91974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad Sep 17 23:43:39 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:39 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad" returned: 0 in 0.504s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:39 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 1G Sep 17 23:43:39 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:39 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 1G" returned: 0 in 0.591s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:40 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 Sep 17 23:43:40 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:40 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608" returned: 0 in 0.411s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:40 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:43:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:40 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 Sep 17 23:43:40 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:40 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608" returned: 0 in 0.312s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:40 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.info Sep 17 23:43:40 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:41 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.info" returned: 0 in 0.274s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:41 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:41 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.info Sep 17 23:43:41 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:41 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.info" returned: 0 in 0.304s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7a04f48f-81ee-417d-bb0a-8f450eeb6b6f tempest-GroupSnapshotsTest-1368429301 None] group_snapshot bf092154-5b7d-4ee4-9dbd-ded9a6a111e4: created successfully Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Flow 'volume_create_manager' (f7be8150-e492-4bcb-9201-88f2feef66e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdd81a4-2eb2-45e4-b755-e82054f84098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdd81a4-2eb2-45e4-b755-e82054f84098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-723328600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6281af8e-21be-455a-94a7-9669fc671111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c814f0e1e24b8b85e67d1ff3ebc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:42Z,use_quota=True,user_id='f474ed96cfd34d56ac77d7b37d6a8be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d395b19b-43f5-48d0-8686-49c15e758171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d395b19b-43f5-48d0-8686-49c15e758171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2d8385-686d-44e7-877a-cba0a6cef700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2d8385-686d-44e7-877a-cba0a6cef700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6281af8e-21be-455a-94a7-9669fc671111', 'volume_name': 'volume-6281af8e-21be-455a-94a7-9669fc671111', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362a2250-b2f3-48f9-b101-9bf424e796de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362a2250-b2f3-48f9-b101-9bf424e796de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90456628-44ac-4ed7-a6fa-978b82a5ab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Volume 6281af8e-21be-455a-94a7-9669fc671111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6281af8e-21be-455a-94a7-9669fc671111', 'volume_size': 1} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-723328600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6281af8e-21be-455a-94a7-9669fc671111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c814f0e1e24b8b85e67d1ff3ebc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:42Z,use_quota=True,user_id='f474ed96cfd34d56ac77d7b37d6a8be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Creating volume 6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:41 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:41 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 1073741824 Sep 17 23:43:41 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] group_snapshot bf092154-5b7d-4ee4-9dbd-ded9a6a111e4: deleting Sep 17 23:43:42 devstack sudo[92008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:42 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] group_snapshot bf092154-5b7d-4ee4-9dbd-ded9a6a111e4: deleting {{(pid=85956) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-00f8f2dd-3ae8-497b-9225-9549cf0491ad" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-00f8f2dd-3ae8-497b-9225-9549cf0491ad" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-70cc3a9f-293c-467e-aea2-c453b3d0d608" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:42 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 1073741824" returned: 0 in 0.599s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-70cc3a9f-293c-467e-aea2-c453b3d0d608" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Deleting offline snapshot 70cc3a9f-293c-467e-aea2-c453b3d0d608 of volume 00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] snapshot_file for this snap is: volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e345ce0-28cf-43bf-8e1c-a2c83b5e41cd]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:42 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 Sep 17 23:43:42 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:42 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.417s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:43:42 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:43:42 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:42 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111" returned: 0 in 0.390s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90456628-44ac-4ed7-a6fa-978b82a5ab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6281af8e-21be-455a-94a7-9669fc671111', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd809c3e-6769-41ea-ba54-6578dba21259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:42 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Volume volume-6281af8e-21be-455a-94a7-9669fc671111 (6281af8e-21be-455a-94a7-9669fc671111): created successfully Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd809c3e-6769-41ea-ba54-6578dba21259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Flow 'volume_create_manager' (f7be8150-e492-4bcb-9201-88f2feef66e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:42 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-36d0fb59-29b5-4145-b4fe-2182d3c89929 tempest-VolumesDeleteCascade-2134963724 None] Created volume successfully. Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608" returned: 0 in 0.530s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:43 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[994ae0dc-4a19-4229-aac6-a4e00b755042]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:43 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad Sep 17 23:43:43 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:43 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad" returned: 0 in 0.547s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:43 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 Sep 17 23:43:43 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:43 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Flow 'volume_create_manager' (1c6ce67b-bfe3-4614-bd74-7f27a1878cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e512ea8d-7222-4db8-a1c0-0dbcc0e65cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e512ea8d-7222-4db8-a1c0-0dbcc0e65cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-261693034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3c623c-1788-4c8f-9b74-d63b6e71a729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80020fd9885432d85c2f28b898b51c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:44Z,use_quota=True,user_id='7c87f85f470e4af8b7781aba39db4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108b272b-773d-4758-83d8-49373e6e1bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108b272b-773d-4758-83d8-49373e6e1bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a948d9f2-760b-4df4-9de4-a3f91549f09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a948d9f2-760b-4df4-9de4-a3f91549f09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3c623c-1788-4c8f-9b74-d63b6e71a729', 'volume_name': 'volume-db3c623c-1788-4c8f-9b74-d63b6e71a729', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0726be-9f32-4fbd-a139-665d1cd99720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0726be-9f32-4fbd-a139-665d1cd99720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d28ab6-d1ef-483f-bd57-d3980793f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:44 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Volume db3c623c-1788-4c8f-9b74-d63b6e71a729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3c623c-1788-4c8f-9b74-d63b6e71a729', 'volume_size': 1} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-261693034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3c623c-1788-4c8f-9b74-d63b6e71a729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80020fd9885432d85c2f28b898b51c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:44Z,use_quota=True,user_id='7c87f85f470e4af8b7781aba39db4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Creating volume db3c623c-1788-4c8f-9b74-d63b6e71a729 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:44 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:44 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 1073741824 Sep 17 23:43:44 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:44 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608" returned: 0 in 0.706s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:44 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608 Sep 17 23:43:44 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:44 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad.70cc3a9f-293c-467e-aea2-c453b3d0d608" returned: 0 in 0.342s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-70cc3a9f-293c-467e-aea2-c453b3d0d608" released by "_delete_snapshot" :: held 2.363s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-00f8f2dd-3ae8-497b-9225-9549cf0491ad" released by "delete_snapshot" :: held 2.391s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:44 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 1073741824" returned: 0 in 0.701s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-f644a3af-cd5d-419d-a704-de009e09bc22 tempest-ServerActionsTestOtherA-1324997458 None] Terminate volume connection completed successfully. Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-f644a3af-cd5d-419d-a704-de009e09bc22 tempest-ServerActionsTestOtherA-1324997458 None] Deleting attachment 03abf4d6-2ba3-4d7f-b93f-29b726ec1d06. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:44 devstack cinder-volume[85956]: WARNING cinder.quota [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2141941106 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2141941106, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:43:44 devstack cinder-volume[85956]: WARNING cinder.quota [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2141941106 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2141941106, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:43:44 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 Sep 17 23:43:44 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['3cb918e0-cb08-43ff-a92e-b438cf6b76cf', '65e04652-aac7-41f7-8fab-531bf9630641', '52aac4f1-ad2d-48c4-8725-ec659adea74d', '931ab4fe-c40e-4523-817f-ef3849d36c3f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "cinder-e91fc92f-ea7b-4e46-a5ed-df942769d457-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-56af3119-002a-4eb4-a7d2-943d19c6ea42 tempest-GroupSnapshotsTest-1368429301 None] group_snapshot bf092154-5b7d-4ee4-9dbd-ded9a6a111e4: deleted successfully Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-e91fc92f-ea7b-4e46-a5ed-df942769d457-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "cinder-quobyte-e91fc92f-ea7b-4e46-a5ed-df942769d457" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-quobyte-e91fc92f-ea7b-4e46-a5ed-df942769d457" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62a0ec3-2e9b-4c8d-a23c-b99948164f41]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:45 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729" returned: 0 in 0.301s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.907s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d28ab6-d1ef-483f-bd57-d3980793f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3c623c-1788-4c8f-9b74-d63b6e71a729', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a73bee-68aa-45c4-b91d-531b5d695875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Creating offline snapshot 2a133798-2ed6-4be2-ba8d-f623a6e388f2 of volume 6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:43:45 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Volume volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 (db3c623c-1788-4c8f-9b74-d63b6e71a729): created successfully Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a73bee-68aa-45c4-b91d-531b5d695875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Flow 'volume_create_manager' (1c6ce67b-bfe3-4614-bd74-7f27a1878cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[693e1e3e-75a1-480a-9c69-ed370f9c4e06]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:45 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 Sep 17 23:43:45 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b7635adb-0d9e-4fcd-a48f-93cd9a1394bf tempest-AttachVolumeNegativeTest-1295557150 None] Created volume successfully. Sep 17 23:43:45 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 Sep 17 23:43:45 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:45 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457" returned: 0 in 0.460s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:45 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457 Sep 17 23:43:45 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "cinder-67b6b381-6c85-4d12-a377-63705af5eb91-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-67b6b381-6c85-4d12-a377-63705af5eb91-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "cinder-quobyte-67b6b381-6c85-4d12-a377-63705af5eb91" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-quobyte-67b6b381-6c85-4d12-a377-63705af5eb91" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:45 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111" returned: 0 in 0.541s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce439ce-c832-423c-b55a-b7d24455c2e8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:45 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 1G Sep 17 23:43:45 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:45 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e91fc92f-ea7b-4e46-a5ed-df942769d457" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:45 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 Sep 17 23:43:45 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-quobyte-e91fc92f-ea7b-4e46-a5ed-df942769d457" released by "delete_volume" :: held 0.893s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.quota [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Created reservations ['61e14ff4-1fa4-4f43-bec4-5abe00ecc96b', '5ae5e23d-df53-455d-96a1-272cb8fc771b', 'ee5d085d-e1d2-4d78-ad71-8eb3becdde94', '57138c98-0213-4491-b15e-035e1c6be01a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "cinder-quobyte-00f8f2dd-3ae8-497b-9225-9549cf0491ad" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-00f8f2dd-3ae8-497b-9225-9549cf0491ad" acquired by "delete_volume" :: waited 0.057s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:46 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:46 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[759ec98a-d40f-460c-b9c8-c37b8d72af54]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:46 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91" returned: 0 in 0.633s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:46 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad Sep 17 23:43:46 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:46 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 1G" returned: 0 in 0.682s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:46 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91 Sep 17 23:43:46 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:46 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 Sep 17 23:43:46 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:46 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.416s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.manager [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:46 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Deleted volume successfully. Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-d13261ff-420f-4d3a-9cb9-538bf78a3115 req-4be4ec85-bc62-421a-bbf3-60b352629646 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-e91fc92f-ea7b-4e46-a5ed-df942769d457-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:46 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-67b6b381-6c85-4d12-a377-63705af5eb91" returned: 0 in 0.386s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-quobyte-67b6b381-6c85-4d12-a377-63705af5eb91" released by "delete_volume" :: held 1.082s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:46 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad" returned: 0 in 0.552s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:46 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad Sep 17 23:43:46 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:46 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:46 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 is being set with open permissions: ugo+rw Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:46 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Created reservations ['997a539a-6c7c-452b-8c8b-6ee52f47218f', '1cb891ce-e79f-4db6-8b44-60bc4c1c263c', '7c5182cc-6a53-4921-b330-e846d5e6a68a', '3372872f-5c4e-45e4-94e3-80482973a8e5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:46 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 Sep 17 23:43:46 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-aa29c830-ca47-4b49-a398-88db5bf157e9 req-948e333f-69b0-4661-9f02-4fa6045a0cec tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:47 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:47 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:47 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-00f8f2dd-3ae8-497b-9225-9549cf0491ad" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Lock "cinder-quobyte-00f8f2dd-3ae8-497b-9225-9549cf0491ad" released by "delete_volume" :: held 0.954s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=142,cinder:UPDATE=145,cinder:INSERT=34,cinder:DELETE=6 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:43:47 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2" returned: 0 in 0.290s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=139,cinder:INSERT=33,cinder:SELECT=140,cinder:DELETE=5 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:47 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:47 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.info Sep 17 23:43:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Deleted volume successfully. Sep 17 23:43:47 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['e8882d94-71d6-4e78-84ba-8a9695e9d5ca'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-68a1d658-c9bd-4c9c-88f9-1ff2d9935c66 tempest-ServerActionsTestOtherA-1324997458 None] Lock "cinder-67b6b381-6c85-4d12-a377-63705af5eb91-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:47 devstack cinder-volume[85956]: WARNING cinder.quota [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2141941106 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2141941106, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Created reservations ['0e908e28-9635-47c6-9b49-72020da1fc53', '64634354-1b42-44ae-97b7-fb3a334c856c', 'dec7fe16-7402-4609-86b6-8b1b6b17115b', '94e03657-b673-4e67-a3a7-94f396ce9e14'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:47 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:43:47 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:47 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.info" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:47 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.info is being set with open permissions: ugo+rw Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:47 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.info Sep 17 23:43:47 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:47 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.276s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:43:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-292415c8-b40a-4c36-813f-6dc03ff2ee71 tempest-GroupSnapshotsTest-1368429301 None] Delete group completed successfully. Sep 17 23:43:47 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.info" returned: 0 in 0.282s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-aa29c830-ca47-4b49-a398-88db5bf157e9 req-948e333f-69b0-4661-9f02-4fa6045a0cec tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.903s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-aa29c830-ca47-4b49-a398-88db5bf157e9 req-948e333f-69b0-4661-9f02-4fa6045a0cec tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4a6dda1b-bf59-48f7-b79b-e48d41ac3555 tempest-VolumesDeleteCascade-2134963724 None] Create snapshot completed successfully Sep 17 23:43:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-aa29c830-ca47-4b49-a398-88db5bf157e9 req-948e333f-69b0-4661-9f02-4fa6045a0cec tempest-AttachVolumeNegativeTest-1295557150 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-db3c623c-1788-4c8f-9b74-d63b6e71a729', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25cc0b78-7674-442f-a9f7-a8b387b631da', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:43:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-aa29c830-ca47-4b49-a398-88db5bf157e9 req-948e333f-69b0-4661-9f02-4fa6045a0cec tempest-AttachVolumeNegativeTest-1295557150 None] attachment_update completed successfully. Sep 17 23:43:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Creating offline snapshot 6961f5f0-72d9-450e-b511-e214cf7270ed of volume 6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:43:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[976783de-b971-4796-9b25-16cc5e82c5ea]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:49 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 Sep 17 23:43:49 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:49 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2" returned: 0 in 0.579s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6281af8e-21be-455a-94a7-9669fc671111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:49 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed 1G Sep 17 23:43:49 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:50 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed 1G" returned: 0 in 0.691s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:50 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed Sep 17 23:43:50 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:50 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:50 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed is being set with open permissions: ugo+rw Sep 17 23:43:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:50 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed Sep 17 23:43:50 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:51 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:51 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-c220a0e4-0577-40c3-8c8f-a9c213bd2d6a req-86b7a55b-7ec5-4d53-8eec-1f1d198963c7 tempest-AttachVolumeNegativeTest-1295557150 None] Terminate volume connection completed successfully. Sep 17 23:43:51 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-c220a0e4-0577-40c3-8c8f-a9c213bd2d6a req-86b7a55b-7ec5-4d53-8eec-1f1d198963c7 tempest-AttachVolumeNegativeTest-1295557150 None] Deleting attachment 25cc0b78-7674-442f-a9f7-a8b387b631da. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:43:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:51 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c854034a-6b62-4f46-88af-23476f49a6fa tempest-VolumesDeleteCascade-2134963724 None] Create snapshot completed successfully Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-6281af8e-21be-455a-94a7-9669fc671111-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-6281af8e-21be-455a-94a7-9669fc671111-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Performing cascade delete. {{(pid=85956) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-2a133798-2ed6-4be2-ba8d-f623a6e388f2-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-2a133798-2ed6-4be2-ba8d-f623a6e388f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-2a133798-2ed6-4be2-ba8d-f623a6e388f2" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-2a133798-2ed6-4be2-ba8d-f623a6e388f2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Deleting offline snapshot 2a133798-2ed6-4be2-ba8d-f623a6e388f2 of volume 6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] snapshot_file for this snap is: volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f774b4-57e8-4bc9-9afb-943905c2c638]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:52 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 Sep 17 23:43:52 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:53 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2" returned: 0 in 0.681s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6281af8e-21be-455a-94a7-9669fc671111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:53 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba97031-fd3f-4be2-a9bb-680c6b284fa1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:53 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 Sep 17 23:43:53 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:53 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111" returned: 0 in 0.473s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:53 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd5392d-d216-4327-be96-327e18622552]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:53 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed Sep 17 23:43:53 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:54 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed" returned: 0 in 0.488s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6281af8e-21be-455a-94a7-9669fc671111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[514744bd-1271-4436-b795-4a603ed74f71]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:54 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 Sep 17 23:43:54 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:54 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2" returned: 0 in 0.462s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6281af8e-21be-455a-94a7-9669fc671111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9934e6af-4786-4c3a-b6fc-b3fffbab32d7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:55 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 Sep 17 23:43:55 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:55 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111" returned: 0 in 0.595s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:55 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 Sep 17 23:43:55 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:55 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2" returned: 0 in 0.407s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:55 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2 Sep 17 23:43:55 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-49beed7d-ddb2-4c0c-aa5e-84d5f097eedb tempest-GroupsTest-1756112752 None] Group tempest-Group1-1423179324: creating Sep 17 23:43:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-49beed7d-ddb2-4c0c-aa5e-84d5f097eedb tempest-GroupsTest-1756112752 None] Group tempest-Group1-1423179324: created successfully Sep 17 23:43:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-49beed7d-ddb2-4c0c-aa5e-84d5f097eedb tempest-GroupsTest-1756112752 None] Create group completed successfully. Sep 17 23:43:56 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.2a133798-2ed6-4be2-ba8d-f623a6e388f2" returned: 0 in 0.425s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed -F qcow2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:56 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed -F qcow2 Sep 17 23:43:56 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:56 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6281af8e-21be-455a-94a7-9669fc671111 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed -F qcow2" returned: 0 in 0.363s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-2a133798-2ed6-4be2-ba8d-f623a6e388f2" released by "_delete_snapshot" :: held 4.218s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" released by "delete_snapshot" :: held 4.242s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Created reservations ['c72e2810-3e09-4907-9883-eef8bb28695b', 'feb13e71-5eaf-4383-bc09-b7c3b71e5c11', '8d6c6e6e-7788-4221-86c6-2729e379a4bd', '2166954a-d514-47db-830a-219fbfe97ba4'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Delete snapshot completed successfully. Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-2a133798-2ed6-4be2-ba8d-f623a6e388f2-delete_snapshot" released by "delete_snapshot" :: held 4.408s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-6961f5f0-72d9-450e-b511-e214cf7270ed-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-6961f5f0-72d9-450e-b511-e214cf7270ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-6961f5f0-72d9-450e-b511-e214cf7270ed" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6961f5f0-72d9-450e-b511-e214cf7270ed" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Deleting offline snapshot 6961f5f0-72d9-450e-b511-e214cf7270ed of volume 6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] snapshot_file for this snap is: volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[385838b2-b241-48d7-b3ef-a68e97d6066d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:57 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed Sep 17 23:43:57 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:57 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed" returned: 0 in 0.456s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6281af8e-21be-455a-94a7-9669fc671111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:43:57 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b94890-d938-4b8e-92f8-f2742985be83]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-27333190-42e8-4bed-9275-f9c597ccb3ec tempest-GroupsTest-1756112752 None] Group tempest-Group2-930579138: creating Sep 17 23:43:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-27333190-42e8-4bed-9275-f9c597ccb3ec tempest-GroupsTest-1756112752 None] Group tempest-Group2-930579138: created successfully Sep 17 23:43:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-27333190-42e8-4bed-9275-f9c597ccb3ec tempest-GroupsTest-1756112752 None] Create group completed successfully. Sep 17 23:43:57 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 Sep 17 23:43:57 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:57 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111" returned: 0 in 0.476s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:57 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed Sep 17 23:43:57 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:58 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed" returned: 0 in 0.428s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:58 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed Sep 17 23:43:58 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:58 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111.6961f5f0-72d9-450e-b511-e214cf7270ed" returned: 0 in 0.385s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6961f5f0-72d9-450e-b511-e214cf7270ed" released by "_delete_snapshot" :: held 1.936s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" released by "delete_snapshot" :: held 1.962s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:58 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Created reservations ['fe514233-0495-40c9-9265-9150488a423f', 'c1ac9259-f911-458b-9d34-0ae0a5c607e4', 'ee313cc9-42c5-4fa0-8973-0da13f66087b', 'a9eaacef-3a11-4459-a95c-8334a605996d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:43:58 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Delete snapshot completed successfully. Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-6961f5f0-72d9-450e-b511-e214cf7270ed-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Snapshots deleted, issuing volume delete {{(pid=85956) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b13580-ec96-4c5c-a2a7-53b39e69c2ff]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:59 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 Sep 17 23:43:59 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Flow 'volume_create_manager' (d81db3b0-3961-4de3-a7ac-dc7963e80659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82636ef2-c1c9-4032-b43d-047265010228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82636ef2-c1c9-4032-b43d-047265010228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901991938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7cf4e23c-9b00-45bb-97cc-9cee44d07eec,host='devstack@QuobyteHD#QuobyteHD',id=a5379468-9dce-40fb-96c9-fefb57bd5028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769757225f1442099c9bc105bba31964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:59Z,use_quota=True,user_id='3e047b3a332f49bebe4acb020e6087d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81a456af-8037-45ff-9bd1-e5fdda4c517f),volume_type_id=81a456af-8037-45ff-9bd1-e5fdda4c517f)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb239a8-fc4c-4c84-a17c-48f191059419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb239a8-fc4c-4c84-a17c-48f191059419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfaff1b-c2af-44fd-a322-3ef098c2dfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfaff1b-c2af-44fd-a322-3ef098c2dfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5379468-9dce-40fb-96c9-fefb57bd5028', 'volume_name': 'volume-a5379468-9dce-40fb-96c9-fefb57bd5028', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc54cc8-6e30-4add-81f1-92d43de646fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc54cc8-6e30-4add-81f1-92d43de646fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5568fea-9b75-46e1-9c7e-5355892aff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:43:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Volume a5379468-9dce-40fb-96c9-fefb57bd5028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5379468-9dce-40fb-96c9-fefb57bd5028', 'volume_size': 1} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7cf4e23c-9b00-45bb-97cc-9cee44d07eec,created_at=2026-09-17T21:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901991938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7cf4e23c-9b00-45bb-97cc-9cee44d07eec,host='devstack@QuobyteHD#QuobyteHD',id=a5379468-9dce-40fb-96c9-fefb57bd5028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769757225f1442099c9bc105bba31964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:43:59Z,use_quota=True,user_id='3e047b3a332f49bebe4acb020e6087d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81a456af-8037-45ff-9bd1-e5fdda4c517f),volume_type_id=81a456af-8037-45ff-9bd1-e5fdda4c517f)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Creating volume a5379468-9dce-40fb-96c9-fefb57bd5028 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:43:59 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:59 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 1073741824 Sep 17 23:43:59 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:43:59 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111" returned: 0 in 0.471s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:43:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:43:59 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111 Sep 17 23:43:59 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:00 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6281af8e-21be-455a-94a7-9669fc671111" returned: 0 in 0.406s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-6281af8e-21be-455a-94a7-9669fc671111" released by "delete_volume" :: held 1.011s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:00 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 1073741824" returned: 0 in 0.626s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Created reservations ['ecc967e1-2d92-436e-bcb5-4319caa6c14b', 'ff800447-3cba-451a-bb9f-d9af21d68e6c', '2e151f2c-92f7-487e-b7ce-44f180782246', 'c5ece2f3-19c7-4acc-954e-70392e402d89'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:00 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 Sep 17 23:44:00 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:00 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:00 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:00 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028" returned: 0 in 0.310s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5568fea-9b75-46e1-9c7e-5355892aff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5379468-9dce-40fb-96c9-fefb57bd5028', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d30e89-19e4-41e5-9b5d-ba6e6d67e89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:00 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Volume volume-a5379468-9dce-40fb-96c9-fefb57bd5028 (a5379468-9dce-40fb-96c9-fefb57bd5028): created successfully Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d30e89-19e4-41e5-9b5d-ba6e6d67e89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Flow 'volume_create_manager' (d81db3b0-3961-4de3-a7ac-dc7963e80659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-cb14a19b-bc0b-4dba-9c78-8f663fb996fb tempest-GroupsTest-1756112752 None] Created volume successfully. Sep 17 23:44:00 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.318s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Deleted volume successfully. Sep 17 23:44:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e394abe6-256b-49a9-b25c-e765f9aef5b4 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-6281af8e-21be-455a-94a7-9669fc671111-delete_volume" released by "delete_volume" :: held 8.374s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Flow 'volume_create_manager' (5714242a-54c5-4d0f-9248-ef2b3f04a53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865fc481-2357-4756-a8db-7a3a1ee34de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865fc481-2357-4756-a8db-7a3a1ee34de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1292949084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c87c95-db16-401a-ab35-6a75469304cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c814f0e1e24b8b85e67d1ff3ebc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:02Z,use_quota=True,user_id='f474ed96cfd34d56ac77d7b37d6a8be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ce8d6f-a92d-475b-b061-3ea75c562149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ce8d6f-a92d-475b-b061-3ea75c562149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab789ea2-e0f5-4de5-a366-7aa5d2035993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab789ea2-e0f5-4de5-a366-7aa5d2035993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c87c95-db16-401a-ab35-6a75469304cc', 'volume_name': 'volume-87c87c95-db16-401a-ab35-6a75469304cc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0b7f3b-2062-43d9-9941-880effe9fded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0b7f3b-2062-43d9-9941-880effe9fded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7fcff7-417e-4d0e-9f6a-d38db9bdba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:02 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Volume 87c87c95-db16-401a-ab35-6a75469304cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c87c95-db16-401a-ab35-6a75469304cc', 'volume_size': 1} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1292949084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c87c95-db16-401a-ab35-6a75469304cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c814f0e1e24b8b85e67d1ff3ebc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:02Z,use_quota=True,user_id='f474ed96cfd34d56ac77d7b37d6a8be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Creating volume 87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:44:02 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:02 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc 1073741824 Sep 17 23:44:02 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Acquiring lock "cinder-quobyte-a5379468-9dce-40fb-96c9-fefb57bd5028" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Lock "cinder-quobyte-a5379468-9dce-40fb-96c9-fefb57bd5028" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b5f02-0922-47f7-8de4-868e4bff43af]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:03 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 Sep 17 23:44:03 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:03 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc 1073741824" returned: 0 in 0.857s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:03 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc Sep 17 23:44:03 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:03 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028" returned: 0 in 0.676s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:03 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028 Sep 17 23:44:03 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:03 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7fcff7-417e-4d0e-9f6a-d38db9bdba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c87c95-db16-401a-ab35-6a75469304cc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0653c9-e792-4f72-a3ee-374d4d076810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:03 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Volume volume-87c87c95-db16-401a-ab35-6a75469304cc (87c87c95-db16-401a-ab35-6a75469304cc): created successfully Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0653c9-e792-4f72-a3ee-374d4d076810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Flow 'volume_create_manager' (5714242a-54c5-4d0f-9248-ef2b3f04a53b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8afc9522-03a3-4450-84d8-a50ee961afa4 tempest-VolumesDeleteCascade-2134963724 None] Created volume successfully. Sep 17 23:44:04 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a5379468-9dce-40fb-96c9-fefb57bd5028" returned: 0 in 0.334s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Lock "cinder-quobyte-a5379468-9dce-40fb-96c9-fefb57bd5028" released by "delete_volume" :: held 1.116s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Created reservations ['4a458c1c-4ec5-46a7-89f2-6bbf160b95f9'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:04 devstack cinder-volume[85956]: WARNING cinder.quota [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1705254620 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1705254620, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:44:04 devstack cinder-volume[85956]: WARNING cinder.quota [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1705254620 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1705254620, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Created reservations ['fe6963dd-fdba-4d8d-8213-a0e484dcf1dc', '170cc631-227c-4a97-9099-1e12a61ac9a6', 'a4e7c565-13ba-47fa-b9d4-44e312ae6e8b', '13bfbf75-5f5e-4905-ac18-b0125e4e0aff'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:04 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:04 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Created reservations ['6a31512a-d927-4550-81df-47a950073e94'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:04 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:04 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:04 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.427s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ca9393fc-81e6-4797-b94e-04552c6ec0db tempest-GroupsTest-1756112752 None] Delete group completed successfully. Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Creating offline snapshot 56c9535e-2534-446b-9ccc-21a2152d1737 of volume 87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2d6bde-fb71-48e7-89fe-a9a8e2c84c7f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:05 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc Sep 17 23:44:05 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:05 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.405s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:05 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-69270872-d1c9-449a-aaa5-fd4e3ca5f671 tempest-GroupsTest-1756112752 None] Delete group completed successfully. Sep 17 23:44:05 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc" returned: 0 in 0.465s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:05 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 1G Sep 17 23:44:05 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:05 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 1G" returned: 0 in 0.593s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c87c95-db16-401a-ab35-6a75469304cc -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:05 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c87c95-db16-401a-ab35-6a75469304cc -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 Sep 17 23:44:05 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-02b5c436-44a3-4a75-b40d-cdddadeeba7f tempest-GroupsTest-1756112752 None] Group tempest-GroupsTest-Group-474289387: creating Sep 17 23:44:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-02b5c436-44a3-4a75-b40d-cdddadeeba7f tempest-GroupsTest-1756112752 None] Group tempest-GroupsTest-Group-474289387: created successfully Sep 17 23:44:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-02b5c436-44a3-4a75-b40d-cdddadeeba7f tempest-GroupsTest-1756112752 None] Create group completed successfully. Sep 17 23:44:06 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c87c95-db16-401a-ab35-6a75469304cc -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737" returned: 0 in 0.796s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:06 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 is being set with open permissions: ugo+rw Sep 17 23:44:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:06 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 Sep 17 23:44:06 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:07 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:07 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.info Sep 17 23:44:07 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:07 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.info" returned: 0 in 0.516s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:07 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.info is being set with open permissions: ugo+rw Sep 17 23:44:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:07 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.info Sep 17 23:44:07 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:08 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.info" returned: 0 in 0.406s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.332s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4714cb26-df81-4d8b-9291-79a304469425 tempest-VolumesDeleteCascade-2134963724 None] Create snapshot completed successfully Sep 17 23:44:08 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Flow 'volume_create_manager' (4f9361ea-aa77-44c0-8fc4-6758693640c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03472cec-73ed-4487-8a88-77c4b1b859f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03472cec-73ed-4487-8a88-77c4b1b859f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608872450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5fd24c97-4e71-4245-a5e2-ba2f7cf0d63d,host='devstack@QuobyteHD#QuobyteHD',id=d4e7fbf7-12dd-4635-ad28-1c600f39918b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769757225f1442099c9bc105bba31964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:09Z,use_quota=True,user_id='3e047b3a332f49bebe4acb020e6087d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(043e4b94-1ce4-44f6-9780-a0a66794fd7f),volume_type_id=043e4b94-1ce4-44f6-9780-a0a66794fd7f)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f2a642-2765-41c3-a882-09a14024552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f2a642-2765-41c3-a882-09a14024552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a668723f-a162-4c8e-b219-70c956d45531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a668723f-a162-4c8e-b219-70c956d45531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e7fbf7-12dd-4635-ad28-1c600f39918b', 'volume_name': 'volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f7e891-52df-4ab6-beee-2a1dd714ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f7e891-52df-4ab6-beee-2a1dd714ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d76e543-f98a-4c1d-8494-285116e2807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:09 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Volume d4e7fbf7-12dd-4635-ad28-1c600f39918b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b', 'volume_size': 1} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5fd24c97-4e71-4245-a5e2-ba2f7cf0d63d,created_at=2026-09-17T21:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608872450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5fd24c97-4e71-4245-a5e2-ba2f7cf0d63d,host='devstack@QuobyteHD#QuobyteHD',id=d4e7fbf7-12dd-4635-ad28-1c600f39918b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769757225f1442099c9bc105bba31964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:09Z,use_quota=True,user_id='3e047b3a332f49bebe4acb020e6087d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(043e4b94-1ce4-44f6-9780-a0a66794fd7f),volume_type_id=043e4b94-1ce4-44f6-9780-a0a66794fd7f)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Creating volume d4e7fbf7-12dd-4635-ad28-1c600f39918b {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:44:09 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:44:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:09 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b 1073741824 Sep 17 23:44:09 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:10 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b 1073741824" returned: 0 in 1.011s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:10 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b Sep 17 23:44:10 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Flow 'volume_create_manager' (e7ca264f-9c41-48b1-ae9a-8d205d457f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bfac58-9aeb-44e3-9d2c-31738c724256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bfac58-9aeb-44e3-9d2c-31738c724256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1767326094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c814f0e1e24b8b85e67d1ff3ebc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=56c9535e-2534-446b-9ccc-21a2152d1737,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:10Z,use_quota=True,user_id='f474ed96cfd34d56ac77d7b37d6a8be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a12110-57c7-454b-b479-7f0cb2c24556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a12110-57c7-454b-b479-7f0cb2c24556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4a9bf6-8d26-4b24-a541-ce3e6b6fd9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4a9bf6-8d26-4b24-a541-ce3e6b6fd9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc', 'volume_name': 'volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc', 'volume_size': 1, 'snapshot_id': '56c9535e-2534-446b-9ccc-21a2152d1737'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff44e51-5138-4486-b732-c7c06d978f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff44e51-5138-4486-b732-c7c06d978f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb7ca04-df3a-4672-b144-688f2de9cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Volume 5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc', 'volume_size': 1, 'snapshot_id': '56c9535e-2534-446b-9ccc-21a2152d1737'} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:10 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b" returned: 0 in 0.472s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.039s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-56c9535e-2534-446b-9ccc-21a2152d1737-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d76e543-f98a-4c1d-8494-285116e2807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6424861-a3ff-4bd7-949a-679a5f0010ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-56c9535e-2534-446b-9ccc-21a2152d1737-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Creating volume 5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc from snapshot 56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Volume volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b (d4e7fbf7-12dd-4635-ad28-1c600f39918b): created successfully Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6424861-a3ff-4bd7-949a-679a5f0010ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Flow 'volume_create_manager' (4f9361ea-aa77-44c0-8fc4-6758693640c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] snapshot: 56c9535e-2534-446b-9ccc-21a2152d1737, volume: 5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:44:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-95810777-1b2f-48c1-9b04-0363dbb291a1 tempest-GroupsTest-1756112752 None] Created volume successfully. Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf8618-e9fa-4089-a56a-4dc726d86f18]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:11 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 Sep 17 23:44:11 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:11 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737" returned: 0 in 0.499s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87c87c95-db16-401a-ab35-6a75469304cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec49e22-cc07-4eff-8c08-9349756c5c11]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:11 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc Sep 17 23:44:11 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:11 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc" returned: 0 in 0.523s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:44:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:12 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc Sep 17 23:44:12 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:12 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Flow 'volume_create_manager' (678ad68b-20b8-4f40-960b-f967ed2b9d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8597a7-1667-4be5-9f6b-b4b40caca3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8597a7-1667-4be5-9f6b-b4b40caca3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1701872956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5fd24c97-4e71-4245-a5e2-ba2f7cf0d63d,host='devstack@QuobyteHD#QuobyteHD',id=5df255d5-7bab-4cc3-891a-a5b99e457ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769757225f1442099c9bc105bba31964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:13Z,use_quota=True,user_id='3e047b3a332f49bebe4acb020e6087d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(043e4b94-1ce4-44f6-9780-a0a66794fd7f),volume_type_id=043e4b94-1ce4-44f6-9780-a0a66794fd7f)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18849d0c-0f8d-4ce8-b059-14acb12ede5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18849d0c-0f8d-4ce8-b059-14acb12ede5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be43981-f77e-4902-97a7-7b755c03e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be43981-f77e-4902-97a7-7b755c03e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df255d5-7bab-4cc3-891a-a5b99e457ee1', 'volume_name': 'volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7738d5-ecc5-441b-ac3e-ff355f860929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7738d5-ecc5-441b-ac3e-ff355f860929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e309fb-0d2b-4e9c-a5fd-1718e8911afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Volume 5df255d5-7bab-4cc3-891a-a5b99e457ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1', 'volume_size': 1} Sep 17 23:44:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:21 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" returned: 0 in 9.980s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:21 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc, size 1024.00 MB, duration 9.98 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:44:21 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Converted 1024.00 MB image at 102.59 MB/s Sep 17 23:44:21 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc is being set with open permissions: ugo+rw Sep 17 23:44:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:21 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc Sep 17 23:44:21 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:22 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" released by "_copy_volume_from_snapshot" :: held 11.441s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-56c9535e-2534-446b-9ccc-21a2152d1737-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" released by "_create_volume_from_snapshot" :: held 11.560s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.601s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.208s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5fd24c97-4e71-4245-a5e2-ba2f7cf0d63d,created_at=2026-09-17T21:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1701872956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5fd24c97-4e71-4245-a5e2-ba2f7cf0d63d,host='devstack@QuobyteHD#QuobyteHD',id=5df255d5-7bab-4cc3-891a-a5b99e457ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769757225f1442099c9bc105bba31964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:13Z,use_quota=True,user_id='3e047b3a332f49bebe4acb020e6087d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(043e4b94-1ce4-44f6-9780-a0a66794fd7f),volume_type_id=043e4b94-1ce4-44f6-9780-a0a66794fd7f)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Creating volume 5df255d5-7bab-4cc3-891a-a5b99e457ee1 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:44:22 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:22 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 1073741824 Sep 17 23:44:22 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb7ca04-df3a-4672-b144-688f2de9cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc', 'volume_size': 1, 'snapshot_id': '56c9535e-2534-446b-9ccc-21a2152d1737'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e533456-cce4-4899-8b83-738d29eff616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Volume volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc (5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc): created successfully Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e533456-cce4-4899-8b83-738d29eff616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Flow 'volume_create_manager' (e7ca264f-9c41-48b1-ae9a-8d205d457f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-890ad761-3a26-46e9-8ea6-c2e48a5f6f7f tempest-VolumesDeleteCascade-2134963724 None] Created volume successfully. Sep 17 23:44:22 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 1073741824" returned: 0 in 0.429s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:22 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 Sep 17 23:44:22 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:23 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1" returned: 0 in 0.270s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e309fb-0d2b-4e9c-a5fd-1718e8911afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b48cdfc-f475-45a8-b608-587857f104e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:23 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Volume volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 (5df255d5-7bab-4cc3-891a-a5b99e457ee1): created successfully Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b48cdfc-f475-45a8-b608-587857f104e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Flow 'volume_create_manager' (678ad68b-20b8-4f40-960b-f967ed2b9d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:23 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-84d457d7-de87-4f8d-89cd-16adbf8e1f43 tempest-GroupsTest-1756112752 None] Created volume successfully. Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-87c87c95-db16-401a-ab35-6a75469304cc-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-87c87c95-db16-401a-ab35-6a75469304cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Performing cascade delete. {{(pid=85956) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-56c9535e-2534-446b-9ccc-21a2152d1737-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-56c9535e-2534-446b-9ccc-21a2152d1737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-87c87c95-db16-401a-ab35-6a75469304cc" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-87c87c95-db16-401a-ab35-6a75469304cc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-56c9535e-2534-446b-9ccc-21a2152d1737" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-56c9535e-2534-446b-9ccc-21a2152d1737" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Deleting offline snapshot 56c9535e-2534-446b-9ccc-21a2152d1737 of volume 87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] snapshot_file for this snap is: volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f49d9-f66b-4837-a2e7-04e17ecb516d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:23 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 Sep 17 23:44:23 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:23 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737" returned: 0 in 0.383s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87c87c95-db16-401a-ab35-6a75469304cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc10d0d-e837-4235-bc44-224154a2d64c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:23 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc Sep 17 23:44:23 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:24 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc" returned: 0 in 0.593s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:24 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 Sep 17 23:44:24 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a54b7c38-07db-472b-836d-fa95a8a3e462 tempest-GroupsTest-1756112752 None] Update group completed successfully. Sep 17 23:44:24 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737" returned: 0 in 0.477s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:24 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737 Sep 17 23:44:24 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:25 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc.56c9535e-2534-446b-9ccc-21a2152d1737" returned: 0 in 0.272s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-56c9535e-2534-446b-9ccc-21a2152d1737" released by "_delete_snapshot" :: held 1.863s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-87c87c95-db16-401a-ab35-6a75469304cc" released by "delete_snapshot" :: held 1.891s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Created reservations ['a2981070-02a1-4af3-9b70-39d7cb65c527', '7c91a0bf-7b22-42ff-befe-953fd55bf352', 'b65f70aa-1272-489b-828e-1ee3d19a1262', '36e46226-b667-498e-8a18-7ed272af0fd0'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Delete snapshot completed successfully. Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-56c9535e-2534-446b-9ccc-21a2152d1737-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Snapshots deleted, issuing volume delete {{(pid=85956) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-87c87c95-db16-401a-ab35-6a75469304cc" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-87c87c95-db16-401a-ab35-6a75469304cc" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82c1a2-f2e3-4495-ae3a-6b5cc7b42b74]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:25 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc Sep 17 23:44:25 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5efdb275-5ee9-43df-b259-3df5f10de836 tempest-GroupsTest-1756112752 None] Update group completed successfully. Sep 17 23:44:26 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc" returned: 0 in 0.577s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:26 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc Sep 17 23:44:26 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:26 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-87c87c95-db16-401a-ab35-6a75469304cc" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-87c87c95-db16-401a-ab35-6a75469304cc" released by "delete_volume" :: held 1.116s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Created reservations ['6b5e2ce7-352f-4676-a915-e6cd0d69a4ff', '638e6184-7fd6-4096-84d1-f78e14fe82bb', 'e4694b9e-cd7b-49ad-8d13-d00b67bc71fc', 'f3bc364b-4638-4360-a562-fd613b57b4f5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:26 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:26 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:27 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.359s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:27 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Deleted volume successfully. Sep 17 23:44:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbf7fee-91c5-4482-af22-8fa0a89f7a5c tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-87c87c95-db16-401a-ab35-6a75469304cc-delete_volume" released by "delete_volume" :: held 3.969s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "cinder-quobyte-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf64eb7a-a285-4eb3-8d97-f2a00afa3a65]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Acquiring lock "cinder-quobyte-5df255d5-7bab-4cc3-891a-a5b99e457ee1" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Lock "cinder-quobyte-5df255d5-7bab-4cc3-891a-a5b99e457ee1" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f6eb5d-6d49-4997-9d1a-b1429c9ab68e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:28 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 Sep 17 23:44:28 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:28 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc Sep 17 23:44:28 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:28 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1" returned: 0 in 0.525s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:28 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1 Sep 17 23:44:28 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:28 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" returned: 0 in 0.736s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:28 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc Sep 17 23:44:28 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:29 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5df255d5-7bab-4cc3-891a-a5b99e457ee1" returned: 0 in 0.536s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Lock "cinder-quobyte-5df255d5-7bab-4cc3-891a-a5b99e457ee1" released by "delete_volume" :: held 1.188s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Acquiring lock "cinder-quobyte-d4e7fbf7-12dd-4635-ad28-1c600f39918b" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Lock "cinder-quobyte-d4e7fbf7-12dd-4635-ad28-1c600f39918b" acquired by "delete_volume" :: waited 0.053s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:29 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" returned: 0 in 0.689s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34df43-0e87-47f9-8b9c-c8a38df2e3e0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-quobyte-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc" released by "delete_volume" :: held 1.579s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:29 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Created reservations ['fbd7b5ea-cb69-4c96-a8e0-eb5498a9dfb7', '5ff2433a-5f59-4fc5-bd1b-c92869c3e07d', '0e2b948f-be3a-4a4f-9218-18f8968f088d', '391eeab7-2416-48b5-bb53-8dcc65928ee0'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:29 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b Sep 17 23:44:29 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:30 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:30 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:30 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b" returned: 0 in 1.073s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:30 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b Sep 17 23:44:30 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:30 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.898s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:31 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Deleted volume successfully. Sep 17 23:44:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1b61f80c-20df-4143-bbe1-e95de1d11b59 tempest-VolumesDeleteCascade-2134963724 None] Lock "cinder-5b44c101-e9ac-4fc8-bcaa-ebc55e2264bc-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:31 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d4e7fbf7-12dd-4635-ad28-1c600f39918b" returned: 0 in 0.879s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Lock "cinder-quobyte-d4e7fbf7-12dd-4635-ad28-1c600f39918b" released by "delete_volume" :: held 2.167s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:31 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Created reservations ['1383b937-6a4a-475f-bf36-3323767ee0b5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:31 devstack cinder-volume[85956]: WARNING cinder.quota [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1844027951 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1844027951, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:44:31 devstack cinder-volume[85956]: WARNING cinder.quota [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1844027951 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1844027951, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:44:31 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Created reservations ['d270967d-fc61-4a8e-a99f-de103e557dc2', '8693e7a4-b728-4566-a935-ebd83355011d', '33050d0c-9f2f-4ce7-af42-795bdfda4114', '0626132c-101e-411c-8ac9-500822dfd23a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:32 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Created reservations ['b955a845-4efa-41c4-aa4f-f28c0692fcfc', '00796306-9b52-4ea7-b8d7-005a403685c2', '02d67be2-a4e7-4cd8-bcbf-b0f8d80b5238', 'bfabdcaa-e641-49fa-9bab-71301bbf1f1e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:32 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:32 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:33 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.514s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:33 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-af7a285f-abdf-4976-8352-56eee4f35f5f tempest-GroupsTest-1756112752 None] Delete group completed successfully. Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Flow 'volume_create_manager' (2c4624e1-23a5-4a67-a2f0-2094ef56f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63f0e02-7ca0-4175-b798-5334fc82a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63f0e02-7ca0-4175-b798-5334fc82a391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680151646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13881d9b-6f83-483d-be0d-140c41debed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80020fd9885432d85c2f28b898b51c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:34Z,use_quota=True,user_id='7c87f85f470e4af8b7781aba39db4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab2e38c-5b7b-47c7-aa04-4843ea36fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab2e38c-5b7b-47c7-aa04-4843ea36fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8de69f-53a9-4aaf-9f1d-f418448b9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8de69f-53a9-4aaf-9f1d-f418448b9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13881d9b-6f83-483d-be0d-140c41debed2', 'volume_name': 'volume-13881d9b-6f83-483d-be0d-140c41debed2', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c624682d-dea9-4883-9d37-d9f87473756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c624682d-dea9-4883-9d37-d9f87473756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39769dca-df62-400e-8a54-1b1c1e063eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:34 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Volume 13881d9b-6f83-483d-be0d-140c41debed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13881d9b-6f83-483d-be0d-140c41debed2', 'volume_size': 1} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680151646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13881d9b-6f83-483d-be0d-140c41debed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80020fd9885432d85c2f28b898b51c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:34Z,use_quota=True,user_id='7c87f85f470e4af8b7781aba39db4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Creating volume 13881d9b-6f83-483d-be0d-140c41debed2 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:44:34 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:44:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:34 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 1073741824 Sep 17 23:44:34 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:35 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 1073741824" returned: 0 in 1.051s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:35 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 Sep 17 23:44:35 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:36 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2" returned: 0 in 0.509s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:44:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39769dca-df62-400e-8a54-1b1c1e063eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13881d9b-6f83-483d-be0d-140c41debed2', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d6db7-3566-4279-bc78-a2d0d2aa8080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Volume volume-13881d9b-6f83-483d-be0d-140c41debed2 (13881d9b-6f83-483d-be0d-140c41debed2): created successfully Sep 17 23:44:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d6db7-3566-4279-bc78-a2d0d2aa8080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Flow 'volume_create_manager' (2c4624e1-23a5-4a67-a2f0-2094ef56f61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1ae072e8-ac14-44b0-b4de-c66cab67f6e8 tempest-AttachVolumeNegativeTest-1295557150 None] Created volume successfully. Sep 17 23:44:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-337ae11a-e0e8-4deb-9c4a-add686d0a88e req-a1dcea7c-e7a1-49f8-85af-5a456d038d75 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-337ae11a-e0e8-4deb-9c4a-add686d0a88e req-a1dcea7c-e7a1-49f8-85af-5a456d038d75 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-337ae11a-e0e8-4deb-9c4a-add686d0a88e req-a1dcea7c-e7a1-49f8-85af-5a456d038d75 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-337ae11a-e0e8-4deb-9c4a-add686d0a88e req-a1dcea7c-e7a1-49f8-85af-5a456d038d75 tempest-AttachVolumeNegativeTest-1295557150 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-13881d9b-6f83-483d-be0d-140c41debed2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bc9dbc1-c2f5-423a-aea5-57b69174d817', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:44:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-337ae11a-e0e8-4deb-9c4a-add686d0a88e req-a1dcea7c-e7a1-49f8-85af-5a456d038d75 tempest-AttachVolumeNegativeTest-1295557150 None] attachment_update completed successfully. Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Flow 'volume_create_manager' (48f5bede-8093-4e45-b2ed-360d05453212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee6085e-35d4-4a62-bcd9-3f5fb8bd7aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee6085e-35d4-4a62-bcd9-3f5fb8bd7aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1402093418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdf886c-2bf9-4b53-b690-7f66ee602047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c7aac9d4bc46609d5c0965102a62ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:39Z,use_quota=True,user_id='8b397e71af2d433c869f8e1294997b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3855d1-c782-47b2-8cff-70ae1c503f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3855d1-c782-47b2-8cff-70ae1c503f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d36e4a-e7b7-41ed-8d49-f1882f3b18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d36e4a-e7b7-41ed-8d49-f1882f3b18a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcdf886c-2bf9-4b53-b690-7f66ee602047', 'volume_name': 'volume-dcdf886c-2bf9-4b53-b690-7f66ee602047', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b53068-56c5-4d0a-be74-dd6b47855190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b53068-56c5-4d0a-be74-dd6b47855190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843bc687-3cb2-4589-acbd-1499648cffdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Volume dcdf886c-2bf9-4b53-b690-7f66ee602047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcdf886c-2bf9-4b53-b690-7f66ee602047', 'volume_size': 1} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1402093418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdf886c-2bf9-4b53-b690-7f66ee602047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c7aac9d4bc46609d5c0965102a62ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:39Z,use_quota=True,user_id='8b397e71af2d433c869f8e1294997b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Creating volume dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:44:39 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:44:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:39 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 1073741824 Sep 17 23:44:39 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:40 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 1073741824" returned: 0 in 0.767s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:40 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 Sep 17 23:44:40 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:41 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047" returned: 0 in 0.612s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:44:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843bc687-3cb2-4589-acbd-1499648cffdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdf886c-2bf9-4b53-b690-7f66ee602047', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355cd043-7831-42cc-9da1-8f99bdb33ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Volume volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 (dcdf886c-2bf9-4b53-b690-7f66ee602047): created successfully Sep 17 23:44:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355cd043-7831-42cc-9da1-8f99bdb33ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Flow 'volume_create_manager' (48f5bede-8093-4e45-b2ed-360d05453212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-671545f3-c63a-46f7-add7-6e7fd78a1028 tempest-VolumesCloneTest-2028702932 None] Created volume successfully. Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:42 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:42 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Flow 'volume_create_manager' (2aedd2ba-779c-49ae-9a96-e722a69be550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:42 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ea4de8-9e51-4df0-86b3-5670d89a58f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.452s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ea4de8-9e51-4df0-86b3-5670d89a58f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1569018068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8ce474-1159-4c2d-a333-19340d1ec164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c7aac9d4bc46609d5c0965102a62ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=dcdf886c-2bf9-4b53-b690-7f66ee602047,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:42Z,use_quota=True,user_id='8b397e71af2d433c869f8e1294997b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef3baa0-ce4d-406b-9f6c-e7399013a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef3baa0-ce4d-406b-9f6c-e7399013a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4399fb4b-6f7a-4daf-8cd3-6971de3e03b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4399fb4b-6f7a-4daf-8cd3-6971de3e03b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4e8ce474-1159-4c2d-a333-19340d1ec164', 'volume_name': 'volume-4e8ce474-1159-4c2d-a333-19340d1ec164', 'volume_size': 2, 'source_volid': 'dcdf886c-2bf9-4b53-b690-7f66ee602047', 'source_volstatus': 'available'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071a7987-1f69-4264-a1af-675831597c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071a7987-1f69-4264-a1af-675831597c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cef9951-366e-417a-a010-000e7443ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:42 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Volume 4e8ce474-1159-4c2d-a333-19340d1ec164: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4e8ce474-1159-4c2d-a333-19340d1ec164', 'volume_size': 2, 'source_volid': 'dcdf886c-2bf9-4b53-b690-7f66ee602047', 'source_volstatus': 'available'} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:42 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Cloning volume dcdf886c-2bf9-4b53-b690-7f66ee602047 to volume 4e8ce474-1159-4c2d-a333-19340d1ec164 Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Creating offline snapshot 1a8beb9d-0600-46f3-8db8-0dc8611e3b69 of volume dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[14db6f2a-445e-4f26-b5b5-c84c15654b72]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:43 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 Sep 17 23:44:43 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:43 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047" returned: 0 in 0.963s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:43 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 1G Sep 17 23:44:43 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-1cf627d1-3168-4aa8-8770-007e1173fdc0 req-19c0051d-8c4e-4810-ae01-7fff703013c5 tempest-AttachVolumeNegativeTest-1295557150 None] Terminate volume connection completed successfully. Sep 17 23:44:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-1cf627d1-3168-4aa8-8770-007e1173fdc0 req-19c0051d-8c4e-4810-ae01-7fff703013c5 tempest-AttachVolumeNegativeTest-1295557150 None] Deleting attachment 1bc9dbc1-c2f5-423a-aea5-57b69174d817. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:44:44 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 1G" returned: 0 in 1.121s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:45 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 Sep 17 23:44:45 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Flow 'volume_create_manager' (45c32f5f-b58b-4ca1-97dd-e77b54806174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d406b6-8437-491c-be82-6e0d42fc0ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d406b6-8437-491c-be82-6e0d42fc0ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1523805764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601ca3ef-79d8-40db-ba28-e8d6205e2b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e6f267f45c4203a235be34305afdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:45Z,use_quota=True,user_id='ff027b81c3a14a9280cca420d72d3082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737fb784-c101-4012-961e-7c8d539bade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737fb784-c101-4012-961e-7c8d539bade0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0119653-d887-40d0-a4e8-acfd8684b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0119653-d887-40d0-a4e8-acfd8684b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601ca3ef-79d8-40db-ba28-e8d6205e2b19', 'volume_name': 'volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393fb889-dd4f-4296-a2f7-636f6730bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393fb889-dd4f-4296-a2f7-636f6730bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32871cb8-8a5a-4ec3-9415-c746e65ad432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:44:45 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Volume 601ca3ef-79d8-40db-ba28-e8d6205e2b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19', 'volume_size': 1} Sep 17 23:44:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:46 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69" returned: 0 in 1.166s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:46 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 is being set with open permissions: ugo+rw Sep 17 23:44:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:46 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 Sep 17 23:44:46 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:46 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69" returned: 0 in 0.606s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:46 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.info Sep 17 23:44:46 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:47 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.info" returned: 0 in 0.628s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:47 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.info is being set with open permissions: ugo+rw Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:47 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.info Sep 17 23:44:47 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:47 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.info" returned: 0 in 0.345s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "cinder-quobyte-4e8ce474-1159-4c2d-a333-19340d1ec164" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-4e8ce474-1159-4c2d-a333-19340d1ec164" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] snapshot: 1a8beb9d-0600-46f3-8db8-0dc8611e3b69, volume: 4e8ce474-1159-4c2d-a333-19340d1ec164, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cc258b-7a06-40d1-bd8d-ce1f387ac1b3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:48 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 Sep 17 23:44:48 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:48 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69" returned: 0 in 0.557s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdf886c-2bf9-4b53-b690-7f66ee602047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:44:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da131fb-3359-437c-8271-4c9f9f178896]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:48 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 Sep 17 23:44:48 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:49 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047" returned: 0 in 0.455s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:44:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:44:49 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:44:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:49 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 Sep 17 23:44:49 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "cinder-13881d9b-6f83-483d-be0d-140c41debed2-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-13881d9b-6f83-483d-be0d-140c41debed2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:53 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:INSERT=27,cinder:SELECT=116,cinder:DELETE=6,cinder:UPDATE=120 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:44:53 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=114,cinder:UPDATE=112,cinder:DELETE=8,cinder:INSERT=28 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:44:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "cinder-quobyte-13881d9b-6f83-483d-be0d-140c41debed2" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-quobyte-13881d9b-6f83-483d-be0d-140c41debed2" acquired by "delete_volume" :: waited 0.055s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:54 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ccfd0a-7611-4657-8ca1-78e48b335b94]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:54 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 Sep 17 23:44:54 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:55 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2" returned: 0 in 1.403s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:55 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2 Sep 17 23:44:55 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:56 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-13881d9b-6f83-483d-be0d-140c41debed2" returned: 0 in 0.734s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-quobyte-13881d9b-6f83-483d-be0d-140c41debed2" released by "delete_volume" :: held 2.362s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Created reservations ['752a1b5d-2d87-4b86-8514-e579927021bf', '9669db0e-3066-4034-a0b4-806d6be1c74f', 'b5119b55-c267-4274-95ea-0ede4a568086', '4932c2cd-c6a7-4165-9e04-dfb71c54934f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:56 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:56 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:57 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.540s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:57 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Deleted volume successfully. Sep 17 23:44:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6143c8b8-b587-489f-8801-189a599f5306 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-13881d9b-6f83-483d-be0d-140c41debed2-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "cinder-db3c623c-1788-4c8f-9b74-d63b6e71a729-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-db3c623c-1788-4c8f-9b74-d63b6e71a729-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "cinder-quobyte-db3c623c-1788-4c8f-9b74-d63b6e71a729" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-quobyte-db3c623c-1788-4c8f-9b74-d63b6e71a729" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:58 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8179d570-38cf-4c94-b2d5-a9571ff49bac]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:58 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 Sep 17 23:44:58 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:58 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729" returned: 0 in 0.603s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:58 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729 Sep 17 23:44:58 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:58 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-db3c623c-1788-4c8f-9b74-d63b6e71a729" returned: 0 in 0.384s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-quobyte-db3c623c-1788-4c8f-9b74-d63b6e71a729" released by "delete_volume" :: held 1.084s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Created reservations ['4272bc1e-1146-4f61-8f5c-4ab3466b8b22', 'fd45af5e-17eb-4999-af42-2fdcc0f51775', '2eaf6332-26dd-42c8-b357-5468d85b7942', '0e6ab261-1594-4b7f-b580-5704b8fd023e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:44:59 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164" returned: 0 in 10.172s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047, size 1024.00 MB, duration 10.17 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:44:59 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Converted 1024.00 MB image at 100.65 MB/s Sep 17 23:44:59 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 is being set with open permissions: ugo+rw Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:59 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 Sep 17 23:44:59 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:59 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:44:59 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:44:59 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164" returned: 0 in 0.300s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-4e8ce474-1159-4c2d-a333-19340d1ec164" released by "_copy_volume_from_snapshot" :: held 11.650s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "cinder-quobyte-1a8beb9d-0600-46f3-8db8-0dc8611e3b69" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:44:59 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.287s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:44:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Deleted volume successfully. Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-1a8beb9d-0600-46f3-8db8-0dc8611e3b69" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Deleting offline snapshot 1a8beb9d-0600-46f3-8db8-0dc8611e3b69 of volume dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] snapshot_file for this snap is: volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedbac86-559a-4ca8-8329-c594f8301db1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d5ae4ef8-6a9b-48a7-b68c-e96334828c35 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-db3c623c-1788-4c8f-9b74-d63b6e71a729-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:44:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:44:59 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 Sep 17 23:44:59 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:00 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69" returned: 0 in 0.401s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdf886c-2bf9-4b53-b690-7f66ee602047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ec5f1c-46b5-4122-8930-43f63d8f131c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:00 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 Sep 17 23:45:00 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "cinder-f9c1d187-a0d9-4a26-9b45-6b8c82f80171-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-f9c1d187-a0d9-4a26-9b45-6b8c82f80171-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "cinder-quobyte-f9c1d187-a0d9-4a26-9b45-6b8c82f80171" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-quobyte-f9c1d187-a0d9-4a26-9b45-6b8c82f80171" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa2730-8ee8-483e-b684-0124d8787fe0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:00 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 Sep 17 23:45:00 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:00 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047" returned: 0 in 0.598s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:00 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 Sep 17 23:45:00 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:00 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171" returned: 0 in 0.394s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:00 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171 Sep 17 23:45:00 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:01 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69" returned: 0 in 0.393s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:01 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69 Sep 17 23:45:01 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:01 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f9c1d187-a0d9-4a26-9b45-6b8c82f80171" returned: 0 in 0.310s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-quobyte-f9c1d187-a0d9-4a26-9b45-6b8c82f80171" released by "delete_volume" :: held 0.757s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Created reservations ['ed95c167-07e0-430f-8edc-b40687d9f4e8', '30128f1a-999b-4ba3-a4ba-e132433efa8f', '72bcfe05-4903-4f09-b173-ff372ae9281e', '75597a63-db66-41fe-bf9e-873d34168916'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:01 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:01 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:01 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047.1a8beb9d-0600-46f3-8db8-0dc8611e3b69" returned: 0 in 0.297s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-1a8beb9d-0600-46f3-8db8-0dc8611e3b69" released by "_delete_snapshot" :: held 1.834s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.635s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.675s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1523805764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601ca3ef-79d8-40db-ba28-e8d6205e2b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e6f267f45c4203a235be34305afdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:44:45Z,use_quota=True,user_id='ff027b81c3a14a9280cca420d72d3082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Creating volume 601ca3ef-79d8-40db-ba28-e8d6205e2b19 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:01 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cef9951-366e-417a-a010-000e7443ed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8ce474-1159-4c2d-a333-19340d1ec164', 'volume_size': 2, 'source_volid': 'dcdf886c-2bf9-4b53-b690-7f66ee602047', 'source_volstatus': 'available'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:01 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 1073741824 Sep 17 23:45:01 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9f70cb-de23-453f-b4a5-abe9ce6f216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Volume volume-4e8ce474-1159-4c2d-a333-19340d1ec164 (4e8ce474-1159-4c2d-a333-19340d1ec164): created successfully Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9f70cb-de23-453f-b4a5-abe9ce6f216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Flow 'volume_create_manager' (2aedd2ba-779c-49ae-9a96-e722a69be550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e8e093e8-24a7-4f6b-b0a3-ebe7ffde08f7 tempest-VolumesCloneTest-2028702932 None] Created volume successfully. Sep 17 23:45:01 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.317s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Deleted volume successfully. Sep 17 23:45:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1329ed4-b5fd-4c85-8827-bdad6ceabcc1 tempest-AttachVolumeNegativeTest-1295557150 None] Lock "cinder-f9c1d187-a0d9-4a26-9b45-6b8c82f80171-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:02 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 1073741824" returned: 0 in 0.670s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:02 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 Sep 17 23:45:02 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:02 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19" returned: 0 in 0.337s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "cinder-4e8ce474-1159-4c2d-a333-19340d1ec164-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32871cb8-8a5a-4ec3-9415-c746e65ad432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4cb1ec-9c0b-4dff-b536-f2a5cca464ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-4e8ce474-1159-4c2d-a333-19340d1ec164-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:02 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Volume volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 (601ca3ef-79d8-40db-ba28-e8d6205e2b19): created successfully Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4cb1ec-9c0b-4dff-b536-f2a5cca464ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Flow 'volume_create_manager' (45c32f5f-b58b-4ca1-97dd-e77b54806174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ddd0c58b-1c99-471a-804a-d71bc2a0faf9 tempest-ServerRescueNegativeTestJSON-1573312337 None] Created volume successfully. Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "cinder-quobyte-4e8ce474-1159-4c2d-a333-19340d1ec164" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-4e8ce474-1159-4c2d-a333-19340d1ec164" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb78ca8-0c6d-437b-b0a1-f97dc58ab616]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:02 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 Sep 17 23:45:02 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:03 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164" returned: 0 in 0.439s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:03 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164 Sep 17 23:45:03 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:03 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e8ce474-1159-4c2d-a333-19340d1ec164" returned: 0 in 0.372s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-4e8ce474-1159-4c2d-a333-19340d1ec164" released by "delete_volume" :: held 0.884s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Created reservations ['9c3cca54-63d5-4adf-99d1-568dea1d7066', 'f7d4967d-edbc-4b1e-b3d5-ff602a258dc7', '75b35640-ac2c-4e12-a637-c6b586b63a66', 'e82e0b8a-fd55-40f7-bddf-1c9755f26209'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:03 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:03 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:04 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.412s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:04 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Deleted volume successfully. Sep 17 23:45:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-41441fdc-b57b-476d-94d1-4a92bfd89999 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-4e8ce474-1159-4c2d-a333-19340d1ec164-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "cinder-dcdf886c-2bf9-4b53-b690-7f66ee602047-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-dcdf886c-2bf9-4b53-b690-7f66ee602047-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "cinder-quobyte-dcdf886c-2bf9-4b53-b690-7f66ee602047" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-dcdf886c-2bf9-4b53-b690-7f66ee602047" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fce62c2-ce95-43ef-acee-61c66b9c08e7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:05 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 Sep 17 23:45:05 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047" returned: 0 in 0.620s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:05 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:05 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047 Sep 17 23:45:05 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:06 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dcdf886c-2bf9-4b53-b690-7f66ee602047" returned: 0 in 0.371s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-quobyte-dcdf886c-2bf9-4b53-b690-7f66ee602047" released by "delete_volume" :: held 1.141s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Created reservations ['73718f3c-d13d-4de5-8e7c-7ed767b1a1a4', 'a61601f1-c49d-4ef3-9da2-cad92a1822cb', 'f833c469-910b-4138-82df-bd9f7a8e3735', '6dcf77ac-6a22-4303-9f8d-fcf97ad0d882'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:06 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:06 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:07 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.427s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:07 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:07 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Deleted volume successfully. Sep 17 23:45:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95e03cc5-1fc1-41c4-abb2-ff8b63245e02 tempest-VolumesCloneTest-2028702932 None] Lock "cinder-dcdf886c-2bf9-4b53-b690-7f66ee602047-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Flow 'volume_create_manager' (94f03b64-03a8-469d-9047-513601384ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7190f6c-5301-4014-92cd-1e13daac76d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7190f6c-5301-4014-92cd-1e13daac76d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-119330682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f191507-9d06-4c33-ade4-d62516b41150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a31ad4f262844d89822431025d21d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:08Z,use_quota=True,user_id='c47f949209ce4f4ba8dbb36124c0bf18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e895a118-bfe4-4fd4-863c-7ae9a456bbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e895a118-bfe4-4fd4-863c-7ae9a456bbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e92aea-dd4e-496d-a1c2-8c4740211585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:08 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:45:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e92aea-dd4e-496d-a1c2-8c4740211585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f191507-9d06-4c33-ade4-d62516b41150', 'volume_name': 'volume-0f191507-9d06-4c33-ade4-d62516b41150', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f41d21-9d34-4e6a-8f64-341639eda7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f41d21-9d34-4e6a-8f64-341639eda7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15558bb7-e4d6-4c3e-9557-2f40e756ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:09 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Volume 0f191507-9d06-4c33-ade4-d62516b41150: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f191507-9d06-4c33-ade4-d62516b41150', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 23:45:09 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Trying to clone 0f191507-9d06-4c33-ade4-d62516b41150 from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:45:10 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:45:10 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Image download 20.69 MB at 20.69 MB/s Sep 17 23:45:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4fb178-a3c9-4d1b-9935-729cbf803511]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:10 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD Sep 17 23:45:10 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:10 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:10 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee is fetched for user c47f949209ce4f4ba8dbb36124c0bf18. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:45:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e1e9b6-551a-43bf-9428-74b2ca61557a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:11 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD Sep 17 23:45:11 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:11 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD" returned: 0 in 0.672s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-119330682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f191507-9d06-4c33-ade4-d62516b41150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a31ad4f262844d89822431025d21d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:08Z,use_quota=True,user_id='c47f949209ce4f4ba8dbb36124c0bf18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Creating volume 0f191507-9d06-4c33-ade4-d62516b41150 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:11 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:11 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 1073741824 Sep 17 23:45:11 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:12 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 1073741824" returned: 0 in 0.601s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:12 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 Sep 17 23:45:12 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:12 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150" returned: 0 in 0.340s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Attempting download of ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 0f191507-9d06-4c33-ade4-d62516b41150. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98b6576-0eaa-402a-89d1-23452cb6e93f]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uh9_kihe {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:12 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uh9_kihe Sep 17 23:45:12 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:13 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uh9_kihe" returned: 0 in 0.552s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uh9_kihe {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:13 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uh9_kihe Sep 17 23:45:13 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:13 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uh9_kihe" returned: 1 in 0.463s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_uh9_kihe' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:45:13 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea1e3d-7a67-42d6-92e5-677a353f2d60]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:13 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD Sep 17 23:45:13 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:14 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:14 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] ecf291a3-5fd0-40b6-8d63-9625bdc973ee was qcow2, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:45:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:14 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 Sep 17 23:45:14 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Acquiring lock "cinder-601ca3ef-79d8-40db-ba28-e8d6205e2b19-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "cinder-601ca3ef-79d8-40db-ba28-e8d6205e2b19-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Acquiring lock "cinder-quobyte-601ca3ef-79d8-40db-ba28-e8d6205e2b19" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "cinder-quobyte-601ca3ef-79d8-40db-ba28-e8d6205e2b19" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcd1875-a1ef-4749-8fb5-73173e67011f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:15 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 Sep 17 23:45:15 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Flow 'volume_create_manager' (7e1f25a3-1746-4f54-93d2-eda2bef6ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b818c3cf-7c5c-4eb0-94d4-cb7d79424aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:15 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Flow 'volume_create_manager' (41f13eb7-1c2f-416d-b0e3-8718e6d70c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f96842-ee2c-47ba-8afc-4fa6a4187bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19" returned: 0 in 0.521s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b818c3cf-7c5c-4eb0-94d4-cb7d79424aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1398680951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17c3e52-3d8e-4be5-8a81-c9ab5bef1780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb153a974474024ae97ef5f2f55c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:15Z,use_quota=True,user_id='bbeb1a418df04b94a5a4e879fff66969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431ab1d4-5b65-4c15-9861-e63307a8323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431ab1d4-5b65-4c15-9861-e63307a8323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:15 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19 Sep 17 23:45:15 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bafa15a-e097-4be4-bc3a-7929d94b80f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bafa15a-e097-4be4-bc3a-7929d94b80f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17c3e52-3d8e-4be5-8a81-c9ab5bef1780', 'volume_name': 'volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f67991-9fb0-4d0a-9c8c-ffa9ace2fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f67991-9fb0-4d0a-9c8c-ffa9ace2fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc617fc-4d17-4dcd-a19c-cbfa3c3cf950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Volume b17c3e52-3d8e-4be5-8a81-c9ab5bef1780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780', 'volume_size': 1} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1398680951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17c3e52-3d8e-4be5-8a81-c9ab5bef1780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb153a974474024ae97ef5f2f55c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:15Z,use_quota=True,user_id='bbeb1a418df04b94a5a4e879fff66969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Creating volume b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:15 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f96842-ee2c-47ba-8afc-4fa6a4187bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1254100594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbde660c314f358e1787919d74f6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:15Z,use_quota=True,user_id='0c2d72f346954383969e4fdd0098f444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7239849-6c82-4e9f-984c-c2cf4db5fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7239849-6c82-4e9f-984c-c2cf4db5fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:15 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 1073741824 Sep 17 23:45:15 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f87a8b3-3783-4c46-b892-3c329eef7c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:45:15 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-601ca3ef-79d8-40db-ba28-e8d6205e2b19" returned: 0 in 0.413s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "cinder-quobyte-601ca3ef-79d8-40db-ba28-e8d6205e2b19" released by "delete_volume" :: held 1.050s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f87a8b3-3783-4c46-b892-3c329eef7c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9', 'volume_name': 'volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9631a0-efe1-459c-8810-862ef735c56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9631a0-efe1-459c-8810-862ef735c56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154e7e53-f25a-49dc-8174-c3350137aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:16 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Volume 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Trying to clone 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Created reservations ['48cf404a-dc51-4206-a99b-757e3c6d5506', 'c80bd99d-df7e-4797-9298-0647ca92a219', '323235bc-800c-46c6-9c6a-e2de4a1b5313', '5425ba6b-f367-40df-ba27-97d79ee5035c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:16 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:16 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:16 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 1073741824" returned: 0 in 0.912s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:16 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 Sep 17 23:45:16 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:16 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:45:16 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Image download 20.69 MB at 20.69 MB/s Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.449s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Deleted volume successfully. Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-594f108e-b996-44c5-90de-4368ffbd30d1 tempest-ServerRescueNegativeTestJSON-1573312337 None] Lock "cinder-601ca3ef-79d8-40db-ba28-e8d6205e2b19-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b8e7a0-8ab1-4c89-88c4-ad37d2c17d08]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:16 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD Sep 17 23:45:16 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:17 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" returned: 0 in 0.381s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc617fc-4d17-4dcd-a19c-cbfa3c3cf950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e4c34e-d255-42b5-8a83-64fc193fbbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:17 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Volume volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 (b17c3e52-3d8e-4be5-8a81-c9ab5bef1780): created successfully Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e4c34e-d255-42b5-8a83-64fc193fbbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Flow 'volume_create_manager' (7e1f25a3-1746-4f54-93d2-eda2bef6ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-9f139ab8-6ba3-42f2-865a-75f0359fb26d req-0d3c0a16-2e82-485e-9576-aa3352bef913 tempest-VolumesSnapshotsTestJSON-1926902908 None] Created volume successfully. Sep 17 23:45:17 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150" returned: 0 in 3.120s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_hso9lh1ydevstack@QuobyteHD, size 112.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:45:17 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Converted 112.00 MB image at 35.88 MB/s Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:17 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 1G Sep 17 23:45:17 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:17 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee is fetched for user 0c2d72f346954383969e4fdd0098f444. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e272e-3464-4f67-b92b-c8dcc7dc5dc3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:17 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD Sep 17 23:45:17 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:17 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 1G" returned: 0 in 0.455s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Downloaded image ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 0f191507-9d06-4c33-ade4-d62516b41150 successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee for user c47f949209ce4f4ba8dbb36124c0bf18 is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Marking volume 0f191507-9d06-4c33-ade4-d62516b41150 as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Copying metadata from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee to 0f191507-9d06-4c33-ade4-d62516b41150. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Creating volume glance metadata for volume 0f191507-9d06-4c33-ade4-d62516b41150 backed by image ecf291a3-5fd0-40b6-8d63-9625bdc973ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15558bb7-e4d6-4c3e-9557-2f40e756ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f191507-9d06-4c33-ade4-d62516b41150', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88bc993-8eba-4f6a-a60c-49ff70f86c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:17 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Volume volume-0f191507-9d06-4c33-ade4-d62516b41150 (0f191507-9d06-4c33-ade4-d62516b41150): created successfully Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88bc993-8eba-4f6a-a60c-49ff70f86c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Flow 'volume_create_manager' (94f03b64-03a8-469d-9047-513601384ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:18 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7d174fef-3494-4ca8-acbd-2c106fa92ca1 tempest-VolumesImageMetadata-563523375 None] Created volume successfully. Sep 17 23:45:18 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1254100594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbde660c314f358e1787919d74f6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:15Z,use_quota=True,user_id='0c2d72f346954383969e4fdd0098f444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Creating volume 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:18 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:18 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 1073741824 Sep 17 23:45:18 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:19 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 1073741824" returned: 0 in 1.038s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:19 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 Sep 17 23:45:19 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Acquiring lock "cinder-0f191507-9d06-4c33-ade4-d62516b41150-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Lock "cinder-0f191507-9d06-4c33-ade4-d62516b41150-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:19 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" returned: 0 in 0.495s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.841s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Creating offline snapshot b18088e3-fa46-43fd-b389-443799658f12 of volume b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850ff03-2c8a-483b-aa9d-081b82fc079e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Acquiring lock "cinder-quobyte-0f191507-9d06-4c33-ade4-d62516b41150" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:19 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Lock "cinder-quobyte-0f191507-9d06-4c33-ade4-d62516b41150" acquired by "delete_volume" :: waited 0.040s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:19 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:19 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Attempting download of ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf97e4-32d1-4824-beed-7e3e61ceed1a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcaaaab-fcc2-4500-b40d-f314ad54eb97]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_h3bs6c44 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:20 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 Sep 17 23:45:20 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:20 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_h3bs6c44 Sep 17 23:45:20 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:20 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" returned: 0 in 0.580s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:20 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 1G Sep 17 23:45:20 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:20 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150" returned: 0 in 0.599s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:20 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150 Sep 17 23:45:20 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:20 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_h3bs6c44" returned: 0 in 0.694s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_h3bs6c44 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:20 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_h3bs6c44 Sep 17 23:45:21 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:21 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_h3bs6c44" returned: 1 in 0.448s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_h3bs6c44' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8901fb1-8be6-4ecc-a303-e40b0ff709c4]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:21 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0f191507-9d06-4c33-ade4-d62516b41150" returned: 0 in 0.647s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:21 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 1G" returned: 0 in 0.892s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Lock "cinder-quobyte-0f191507-9d06-4c33-ade4-d62516b41150" released by "delete_volume" :: held 1.360s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:21 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 Sep 17 23:45:21 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Created reservations ['dd108d2e-c82b-4157-8957-07d18d403475', 'c489f32e-5aad-42ca-93ba-12e658009339', '93676ce9-dff3-4e6b-9aa9-eba690f7abd8', '9542f259-1c58-4078-816e-00145c577131'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:21 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD Sep 17 23:45:21 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:21 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:21 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:21 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12" returned: 0 in 0.403s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:21 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 is being set with open permissions: ugo+rw Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:21 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 Sep 17 23:45:21 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:21 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] ecf291a3-5fd0-40b6-8d63-9625bdc973ee was qcow2, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:21 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 Sep 17 23:45:21 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:21 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.379s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:21 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Deleted volume successfully. Sep 17 23:45:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f93e5a8c-0e22-4b29-bee9-0a66da5b415e tempest-VolumesImageMetadata-563523375 None] Lock "cinder-0f191507-9d06-4c33-ade4-d62516b41150-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:22 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:22 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.info Sep 17 23:45:22 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:22 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.info" returned: 0 in 0.356s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:22 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.info is being set with open permissions: ugo+rw Sep 17 23:45:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:22 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.info Sep 17 23:45:22 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:22 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.info" returned: 0 in 0.309s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.037s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-52273105-a07b-47c6-bd62-e4e659b7a1f8 req-dc487d0e-8077-4cd4-99ba-a140b3b485f6 tempest-VolumesSnapshotsTestJSON-1926902908 None] Create snapshot completed successfully Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "cinder-b18088e3-fa46-43fd-b389-443799658f12-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-b18088e3-fa46-43fd-b389-443799658f12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "cinder-quobyte-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-quobyte-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "cinder-quobyte-b18088e3-fa46-43fd-b389-443799658f12" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-quobyte-b18088e3-fa46-43fd-b389-443799658f12" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Deleting offline snapshot b18088e3-fa46-43fd-b389-443799658f12 of volume b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] snapshot_file for this snap is: volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4960844-7492-42a7-a896-a2cafac0a7f8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:24 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 Sep 17 23:45:24 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:24 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" returned: 0 in 2.822s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_3tcn8dpjdevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:45:24 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Converted 112.00 MB image at 39.65 MB/s Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:24 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 1G Sep 17 23:45:24 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:24 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12" returned: 0 in 0.553s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b8b9a9-c05e-4eaf-a461-2c08dedb2eb1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:24 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 Sep 17 23:45:24 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:25 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 1G" returned: 0 in 0.477s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Downloaded image ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee for user 0c2d72f346954383969e4fdd0098f444 is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Marking volume 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Copying metadata from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee to 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Creating volume glance metadata for volume 3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 backed by image ecf291a3-5fd0-40b6-8d63-9625bdc973ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154e7e53-f25a-49dc-8174-c3350137aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c585d97-5383-4465-a41f-21ba9a920903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:25 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" returned: 0 in 0.521s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:25 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Volume volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 (3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9): created successfully Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c585d97-5383-4465-a41f-21ba9a920903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Flow 'volume_create_manager' (41f13eb7-1c2f-416d-b0e3-8718e6d70c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:25 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 Sep 17 23:45:25 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4e6a6710-6e5c-426c-97e7-f1e704460758 tempest-VolumesExtendTest-892567202 None] Created volume successfully. Sep 17 23:45:25 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12" returned: 0 in 0.334s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:25 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12 Sep 17 23:45:25 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:25 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780.b18088e3-fa46-43fd-b389-443799658f12" returned: 0 in 0.255s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-quobyte-b18088e3-fa46-43fd-b389-443799658f12" released by "_delete_snapshot" :: held 1.828s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-quobyte-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" released by "delete_snapshot" :: held 1.857s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG cinder.quota [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Created reservations ['13a138eb-110c-4d9d-9c8f-7411c2fbb45a', '93b124be-8cf6-4f3e-bb75-c4784e5cb790', 'ec8cc05c-1a6f-438c-9e6d-e5b0891b5dbf', '0eb34157-f11b-4db3-a5a6-c057565b78c9'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Delete snapshot completed successfully. Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-dc0efbd8-9114-4195-98f4-2dc0de4036e4 req-b0a50d43-8db0-4fc9-a9dd-a0517a9dac97 tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-b18088e3-fa46-43fd-b389-443799658f12-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "cinder-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "cinder-quobyte-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-quobyte-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" acquired by "delete_volume" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2a4eee-4124-4883-a3d2-dca703f5852a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[50595a2f-35ad-46af-8876-1816ad5092c0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:26 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 Sep 17 23:45:26 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:26 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 Sep 17 23:45:26 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:27 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" returned: 0 in 0.445s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:27 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" returned: 0 in 0.448s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 2G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:27 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780 Sep 17 23:45:27 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 2G" returned: 0 in 0.150s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.640s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d0e75f62-96dc-4a4d-9577-e49efc62ff3f tempest-VolumesExtendTest-892567202 None] Extend volume completed successfully. Sep 17 23:45:27 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" returned: 0 in 0.334s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-quobyte-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780" released by "delete_volume" :: held 0.879s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG cinder.quota [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Created reservations ['e53d387f-bc0f-4fef-8339-ad47c2dc0ab4', '0ae21fb2-c2f2-45fa-88b5-4b1ce6b56add', '310535e5-b888-46d3-9855-aec0df3904c0', '5e38b096-8c68-4b5f-9b56-898effd7b301'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:27 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:27 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:28 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.426s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG cinder.manager [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Deleted volume successfully. Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6754da29-3c67-404c-8fbc-69ccaa84d217 req-473fb485-efba-4d1b-9e78-aa544c3220cd tempest-VolumesSnapshotsTestJSON-1926902908 None] Lock "cinder-b17c3e52-3d8e-4be5-8a81-c9ab5bef1780-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Acquiring lock "cinder-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Lock "cinder-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Acquiring lock "cinder-quobyte-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe5901-4fad-4a8f-969f-7d69d51ffa07]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:28 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 Sep 17 23:45:28 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:28 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" returned: 0 in 0.450s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:28 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9 Sep 17 23:45:28 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:29 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" returned: 0 in 0.285s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9" released by "delete_volume" :: held 0.794s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Created reservations ['52a2c36b-b3e6-4775-b956-be7771df41e6', 'be4ec820-8f82-44d4-87d0-be487b4d0a09', 'af40f5d5-7b0c-48bb-a573-f20b4da8327b', '9bc49add-f49e-401b-9b0a-48dc7f78b2ee'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:29 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:29 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:29 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.328s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:29 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Deleted volume successfully. Sep 17 23:45:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2da6f1fd-aa15-40ef-a550-5cf6c7410f16 tempest-VolumesExtendTest-892567202 None] Lock "cinder-3c2fbad5-fac9-4fcd-8cb4-91d9be5ef5b9-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Flow 'volume_create_manager' (7bf830aa-2520-48f9-8614-87893fa6cd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a6bd0e-13f8-4003-b436-05c203a674b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a6bd0e-13f8-4003-b436-05c203a674b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-447920236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce673a1-ca26-4e6c-a63c-48180d619277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbde660c314f358e1787919d74f6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:30Z,use_quota=True,user_id='0c2d72f346954383969e4fdd0098f444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cac7f8-f7a7-443c-a6da-b780c78fdd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cac7f8-f7a7-443c-a6da-b780c78fdd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4e0f76-65d2-40d8-8756-d3d97f31eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4e0f76-65d2-40d8-8756-d3d97f31eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce673a1-ca26-4e6c-a63c-48180d619277', 'volume_name': 'volume-1ce673a1-ca26-4e6c-a63c-48180d619277', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2628e1-62c6-4698-bd3f-4224064c82d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2628e1-62c6-4698-bd3f-4224064c82d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5511c00-ce32-4614-86a0-e05b8faa7f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:30 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Volume 1ce673a1-ca26-4e6c-a63c-48180d619277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce673a1-ca26-4e6c-a63c-48180d619277', 'volume_size': 1} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-447920236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce673a1-ca26-4e6c-a63c-48180d619277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbde660c314f358e1787919d74f6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:30Z,use_quota=True,user_id='0c2d72f346954383969e4fdd0098f444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Creating volume 1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:30 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:30 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 1073741824 Sep 17 23:45:30 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:31 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 1073741824" returned: 0 in 0.639s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:31 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 Sep 17 23:45:31 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:31 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277" returned: 0 in 0.358s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5511c00-ce32-4614-86a0-e05b8faa7f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce673a1-ca26-4e6c-a63c-48180d619277', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6cbfd9-f291-4060-b4e4-97f378940799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:31 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Volume volume-1ce673a1-ca26-4e6c-a63c-48180d619277 (1ce673a1-ca26-4e6c-a63c-48180d619277): created successfully Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6cbfd9-f291-4060-b4e4-97f378940799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Flow 'volume_create_manager' (7bf830aa-2520-48f9-8614-87893fa6cd81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a7ee7389-3a30-4d1b-98a6-e1cef701492c tempest-VolumesExtendTest-892567202 None] Created volume successfully. Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (d8108843-88db-42f7-82cd-cc6911551415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acb8851-c808-4082-bb53-d0bff5e69a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acb8851-c808-4082-bb53-d0bff5e69a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1854337842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703a2cc9-eba1-4454-8c3d-0f959edf2444,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:32Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8b849a-c9fa-47b2-b23a-4cb2b0a3a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8b849a-c9fa-47b2-b23a-4cb2b0a3a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfce4d0d-1526-437c-82a8-75d6a9e16af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfce4d0d-1526-437c-82a8-75d6a9e16af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703a2cc9-eba1-4454-8c3d-0f959edf2444', 'volume_name': 'volume-703a2cc9-eba1-4454-8c3d-0f959edf2444', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41373019-a47b-47de-bd0e-25e442e7ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41373019-a47b-47de-bd0e-25e442e7ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1c3234-255f-467b-8ad9-f9556fbb35bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:32 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Volume 703a2cc9-eba1-4454-8c3d-0f959edf2444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703a2cc9-eba1-4454-8c3d-0f959edf2444', 'volume_size': 1} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1854337842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703a2cc9-eba1-4454-8c3d-0f959edf2444,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:32Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Creating volume 703a2cc9-eba1-4454-8c3d-0f959edf2444 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:32 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:32 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 1073741824 Sep 17 23:45:32 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:32 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 1073741824" returned: 0 in 0.588s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:32 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 Sep 17 23:45:32 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:33 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444" returned: 0 in 0.283s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.513s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1c3234-255f-467b-8ad9-f9556fbb35bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703a2cc9-eba1-4454-8c3d-0f959edf2444', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97779dfb-d890-42d8-8b32-a04d3b38857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Creating offline snapshot a3e50c4f-a83e-424e-aaae-9470723541c4 of volume 1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:45:33 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Volume volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 (703a2cc9-eba1-4454-8c3d-0f959edf2444): created successfully Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97779dfb-d890-42d8-8b32-a04d3b38857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (d8108843-88db-42f7-82cd-cc6911551415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81a3201-c15e-413b-b6f5-11f49b6f2e7b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-951ef4d9-9a59-4501-98e1-96d7cff9a669 tempest-VolumesGetTest-782838041 None] Created volume successfully. Sep 17 23:45:33 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 Sep 17 23:45:33 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:33 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277" returned: 0 in 0.421s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:33 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 1G Sep 17 23:45:33 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4d6c3f4f-6d87-4926-8e7f-eb712108ef47 tempest-BackendsCapabilitiesAdminTestsJSON-126862161 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.770751953125, 'free_capacity_gb': 1775.770751953125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85956) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-52847440-9da8-4b74-81d7-3bda2fd9ba9b tempest-BackendsCapabilitiesAdminTestsJSON-126862161 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.770751953125, 'free_capacity_gb': 1775.770751953125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85956) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 23:45:34 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 1G" returned: 0 in 0.542s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce673a1-ca26-4e6c-a63c-48180d619277 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:34 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce673a1-ca26-4e6c-a63c-48180d619277 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 Sep 17 23:45:34 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:34 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce673a1-ca26-4e6c-a63c-48180d619277 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4" returned: 0 in 0.374s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:34 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 is being set with open permissions: ugo+rw Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:34 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 Sep 17 23:45:34 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:34 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4" returned: 0 in 0.331s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:34 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.info Sep 17 23:45:34 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (4d6b3d5a-d4e2-4077-bed1-cbd997756e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b179165-67b7-472f-8846-d27371fa265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b179165-67b7-472f-8846-d27371fa265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-928351706',display_name='tempest-VolumesGetTest-Volume-1705469650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b6a635-6aa6-485d-9e6c-1aba98d1d7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:35Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8d9201-4dcc-4568-9538-0cacb89372de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8d9201-4dcc-4568-9538-0cacb89372de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bd74ea-1fed-45b9-a3f4-beec6c0c1126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bd74ea-1fed-45b9-a3f4-beec6c0c1126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b6a635-6aa6-485d-9e6c-1aba98d1d7cc', 'volume_name': 'volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8795c96-cf1e-45b4-84dc-9d9e8ce9083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8795c96-cf1e-45b4-84dc-9d9e8ce9083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdb5949-0f6d-4dce-812c-86046119fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:35 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Volume 56b6a635-6aa6-485d-9e6c-1aba98d1d7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc', 'volume_size': 1} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:35 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.info" returned: 0 in 0.452s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:35 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.info is being set with open permissions: ugo+rw Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:35 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.info Sep 17 23:45:35 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:35 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.info" returned: 0 in 0.294s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-928351706',display_name='tempest-VolumesGetTest-Volume-1705469650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b6a635-6aa6-485d-9e6c-1aba98d1d7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:35Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Creating volume 56b6a635-6aa6-485d-9e6c-1aba98d1d7cc {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:35 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:35 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc 1073741824 Sep 17 23:45:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-92caa841-61f5-4cb0-95d7-e775b8138649 tempest-VolumesExtendTest-892567202 None] Create snapshot completed successfully Sep 17 23:45:35 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:36 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc 1073741824" returned: 0 in 0.559s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:36 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc Sep 17 23:45:36 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:36 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc" returned: 0 in 0.285s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdb5949-0f6d-4dce-812c-86046119fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f429210b-dacf-4c5a-9f2c-d4b8559dcfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Volume volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc (56b6a635-6aa6-485d-9e6c-1aba98d1d7cc): created successfully Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f429210b-dacf-4c5a-9f2c-d4b8559dcfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (4d6b3d5a-d4e2-4077-bed1-cbd997756e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-58074e4f-ab34-491d-b84e-c1cf2f405bb5 tempest-VolumesGetTest-782838041 None] Created volume successfully. Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09eda54-8fe0-4538-981e-ac61241fa1c8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:37 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 Sep 17 23:45:37 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Lock "cinder-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:37 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277" returned: 0 in 0.600s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 2G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[713b0079-0a0c-4bcd-950a-f30664d0c9f7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:37 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc Sep 17 23:45:37 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 2G" returned: 0 in 0.192s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.831s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d46f6b32-5945-456b-9fc7-469e741a43ff tempest-VolumesExtendTest-892567202 None] Extend volume completed successfully. Sep 17 23:45:38 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc" returned: 0 in 0.474s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:38 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc Sep 17 23:45:38 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Acquiring lock "cinder-a3e50c4f-a83e-424e-aaae-9470723541c4-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Lock "cinder-a3e50c4f-a83e-424e-aaae-9470723541c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Acquiring lock "cinder-quobyte-1ce673a1-ca26-4e6c-a63c-48180d619277" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-1ce673a1-ca26-4e6c-a63c-48180d619277" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Acquiring lock "cinder-quobyte-a3e50c4f-a83e-424e-aaae-9470723541c4" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-a3e50c4f-a83e-424e-aaae-9470723541c4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Deleting offline snapshot a3e50c4f-a83e-424e-aaae-9470723541c4 of volume 1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] snapshot_file for this snap is: volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f96c620-27e3-4ed7-9bf5-61cc2463658c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:38 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc" returned: 0 in 0.404s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc" released by "delete_volume" :: held 0.972s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Created reservations ['6f03ce7e-30fc-4fb6-8704-d8abf7330139', 'e5be68ea-eca8-4dc6-b953-d1614ebca4f8', '081cb35d-2086-47ae-9e9e-8819133d5906', 'ccc289ee-aa27-4a02-ba2d-2d78b5d36bb2'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:38 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 Sep 17 23:45:38 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:38 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:38 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-703a2cc9-eba1-4454-8c3d-0f959edf2444-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Lock "cinder-703a2cc9-eba1-4454-8c3d-0f959edf2444-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-703a2cc9-eba1-4454-8c3d-0f959edf2444" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-703a2cc9-eba1-4454-8c3d-0f959edf2444" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2b5af-b36f-4a89-867d-a3c0a7080062]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:39 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4" returned: 0 in 0.673s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce673a1-ca26-4e6c-a63c-48180d619277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a74015-90f3-496e-8297-aba77113ee23]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:39 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.446s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Deleted volume successfully. Sep 17 23:45:39 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 Sep 17 23:45:39 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a1b65915-ad5b-4847-a256-466b2623dfbe tempest-VolumesGetTest-782838041 None] Lock "cinder-56b6a635-6aa6-485d-9e6c-1aba98d1d7cc-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:39 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 Sep 17 23:45:39 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:39 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444" returned: 0 in 0.468s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:39 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444 Sep 17 23:45:39 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:39 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277" returned: 0 in 0.511s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:39 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 Sep 17 23:45:39 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:39 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-703a2cc9-eba1-4454-8c3d-0f959edf2444" returned: 0 in 0.302s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-703a2cc9-eba1-4454-8c3d-0f959edf2444" released by "delete_volume" :: held 0.835s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:39 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Created reservations ['a908f017-977d-412a-9097-9d4ee1f76810', 'e29e452e-335f-4ebc-b69f-2d00024656d3', 'f05416c0-1c14-45f8-bcb8-5c2f1ba91e74', '320ef303-ee08-4fc5-8277-d545dc920cb8'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:40 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:40 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:40 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4" returned: 0 in 0.536s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:40 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4 Sep 17 23:45:40 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:40 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.553s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Deleted volume successfully. Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2c52e7cb-bced-46a7-844a-29ee9e2abbf5 tempest-VolumesGetTest-782838041 None] Lock "cinder-703a2cc9-eba1-4454-8c3d-0f959edf2444-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:40 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277.a3e50c4f-a83e-424e-aaae-9470723541c4" returned: 0 in 0.619s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-a3e50c4f-a83e-424e-aaae-9470723541c4" released by "_delete_snapshot" :: held 2.572s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-1ce673a1-ca26-4e6c-a63c-48180d619277" released by "delete_snapshot" :: held 2.614s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Created reservations ['70cca234-5a88-4ad4-97cb-607f2c8cd7f1', '1af8e481-2cd7-4a7b-b385-0a79cbffa9d8', 'fc7177bc-d74f-463a-bf9f-beb78b9ce1d5', '84234584-bbd7-463e-81aa-49b29af7a9fa'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Delete snapshot completed successfully. Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (83f4fea5-2adc-4fe0-88c7-075f9ac94cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0108e80d-bd6c-497e-a418-cb036edb0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c4b7124-dd13-4db9-b1a8-728c3859a619 tempest-VolumesExtendTest-892567202 None] Lock "cinder-a3e50c4f-a83e-424e-aaae-9470723541c4-delete_snapshot" released by "delete_snapshot" :: held 2.946s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0108e80d-bd6c-497e-a418-cb036edb0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2100639233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30a0179-a645-4427-9fac-0baa4b1b30f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:41Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4c0e46-86a6-4f28-a20d-4d0274fbc52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4c0e46-86a6-4f28-a20d-4d0274fbc52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcaa187-dcb4-4314-9da7-2e59c51a1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcaa187-dcb4-4314-9da7-2e59c51a1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30a0179-a645-4427-9fac-0baa4b1b30f2', 'volume_name': 'volume-a30a0179-a645-4427-9fac-0baa4b1b30f2', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c022312e-8c8e-4682-80ca-58a7ca840624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c022312e-8c8e-4682-80ca-58a7ca840624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96bad13-6b38-49ce-9638-4dd7957d4158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Volume a30a0179-a645-4427-9fac-0baa4b1b30f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30a0179-a645-4427-9fac-0baa4b1b30f2', 'volume_size': 1} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2100639233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30a0179-a645-4427-9fac-0baa4b1b30f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:41Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Creating volume a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:41 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:41 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 1073741824 Sep 17 23:45:41 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Acquiring lock "cinder-1ce673a1-ca26-4e6c-a63c-48180d619277-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Lock "cinder-1ce673a1-ca26-4e6c-a63c-48180d619277-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Acquiring lock "cinder-quobyte-1ce673a1-ca26-4e6c-a63c-48180d619277" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-1ce673a1-ca26-4e6c-a63c-48180d619277" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7b5362-64ce-42de-b64e-23e8cd229058]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:41 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 1073741824" returned: 0 in 0.543s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:42 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 Sep 17 23:45:42 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:42 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 Sep 17 23:45:42 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:42 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:42 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:42 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2" returned: 0 in 0.390s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:42 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96bad13-6b38-49ce-9638-4dd7957d4158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30a0179-a645-4427-9fac-0baa4b1b30f2', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d581cc-ec45-43e4-8e17-b1dd18909fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277" returned: 0 in 0.555s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:42 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Volume volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 (a30a0179-a645-4427-9fac-0baa4b1b30f2): created successfully Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d581cc-ec45-43e4-8e17-b1dd18909fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:42 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277 Sep 17 23:45:42 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (83f4fea5-2adc-4fe0-88c7-075f9ac94cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d1b53adf-59c2-4c74-a99a-e7f3f12f6329 tempest-VolumesGetTest-782838041 None] Created volume successfully. Sep 17 23:45:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4b79e9cd-f354-4d35-900d-c382b911b99f tempest-GroupSnapshotsV319Test-1316212412 None] Group tempest-GroupSnapshotsV319Test-Group-378625713: creating Sep 17 23:45:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4b79e9cd-f354-4d35-900d-c382b911b99f tempest-GroupSnapshotsV319Test-1316212412 None] Group tempest-GroupSnapshotsV319Test-Group-378625713: created successfully Sep 17 23:45:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4b79e9cd-f354-4d35-900d-c382b911b99f tempest-GroupSnapshotsV319Test-1316212412 None] Create group completed successfully. Sep 17 23:45:42 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.393s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:45:42 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1ce673a1-ca26-4e6c-a63c-48180d619277" returned: 0 in 0.328s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Lock "cinder-quobyte-1ce673a1-ca26-4e6c-a63c-48180d619277" released by "delete_volume" :: held 0.952s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Created reservations ['59e1f995-f081-45c2-a3ee-224c1410341e', 'f3583fcc-2913-47eb-9f10-e238647d100e', '3f8435ed-e18d-48fa-950c-04e08337d116', 'b2dfbe1d-5cf6-4939-9a0d-29a276acb83e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:42 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:45:42 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:43 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.282s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:45:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Deleted volume successfully. Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a951fa9-a417-4c0b-9ccc-3ce1e1080786 tempest-VolumesExtendTest-892567202 None] Lock "cinder-1ce673a1-ca26-4e6c-a63c-48180d619277-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (cfbff869-1c63-4382-9c2c-f99ab419e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4070e42-914e-4867-ac9c-b37e72d13392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4070e42-914e-4867-ac9c-b37e72d13392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-434338982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f9a66a-823f-4b2c-9e07-cf4eb9e20479,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a30a0179-a645-4427-9fac-0baa4b1b30f2,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:44Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0b1ac7-030c-46e2-8714-17c9d4d4188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0b1ac7-030c-46e2-8714-17c9d4d4188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d7b09f-4df3-4095-b531-bfdfe479d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d7b09f-4df3-4095-b531-bfdfe479d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '84f9a66a-823f-4b2c-9e07-cf4eb9e20479', 'volume_name': 'volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479', 'volume_size': 1, 'source_volid': 'a30a0179-a645-4427-9fac-0baa4b1b30f2', 'source_volstatus': 'available'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb32d26-ccb5-46e5-b8b9-0c0cb4e463af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb32d26-ccb5-46e5-b8b9-0c0cb4e463af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b406df-dc8f-43f8-80d2-3b3f4cb488c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:43 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Volume 84f9a66a-823f-4b2c-9e07-cf4eb9e20479: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479', 'volume_size': 1, 'source_volid': 'a30a0179-a645-4427-9fac-0baa4b1b30f2', 'source_volstatus': 'available'} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:43 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Cloning volume a30a0179-a645-4427-9fac-0baa4b1b30f2 to volume 84f9a66a-823f-4b2c-9e07-cf4eb9e20479 Sep 17 23:45:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Creating offline snapshot 771cd981-56a5-4087-983c-bd701658a11e of volume a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95db532-eb29-40bb-be41-1496eeab7428]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:44 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 Sep 17 23:45:44 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Flow 'volume_create_manager' (00071c4f-674f-482c-9627-c97fb4ae6df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9fde783-8c0a-4954-9da0-82f1ecb4cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9fde783-8c0a-4954-9da0-82f1ecb4cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246682408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f59c4476-6073-4f7c-be52-1f08b9edd441,host='devstack@QuobyteHD#QuobyteHD',id=ad052972-aead-4cc4-a2c2-c224c4310f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4777def592c4414083dafce7ea0ffc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:44Z,use_quota=True,user_id='968ba6dd0c8144e48db2b95ed4348eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4891551a-9e2c-41d8-89b1-e7e29655f3c8),volume_type_id=4891551a-9e2c-41d8-89b1-e7e29655f3c8)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c3f7cf-44fb-4373-be8f-74e69c145b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c3f7cf-44fb-4373-be8f-74e69c145b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f714d2d7-92f2-492d-b971-963ebfe253e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f714d2d7-92f2-492d-b971-963ebfe253e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad052972-aead-4cc4-a2c2-c224c4310f3e', 'volume_name': 'volume-ad052972-aead-4cc4-a2c2-c224c4310f3e', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9371dd59-3ae0-4c47-ba37-f6f9e55f35dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9371dd59-3ae0-4c47-ba37-f6f9e55f35dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737dfc5b-ba5c-413d-8329-523c548b3c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:44 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Volume ad052972-aead-4cc4-a2c2-c224c4310f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad052972-aead-4cc4-a2c2-c224c4310f3e', 'volume_size': 1} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:44 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2" returned: 0 in 0.763s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:44 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e 1G Sep 17 23:45:44 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:45 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e 1G" returned: 0 in 0.514s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:45 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e Sep 17 23:45:45 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:45 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e" returned: 0 in 0.389s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:45 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e is being set with open permissions: ugo+rw Sep 17 23:45:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:45 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e Sep 17 23:45:45 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:46 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e" returned: 0 in 0.315s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:46 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.info Sep 17 23:45:46 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:46 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.info" returned: 0 in 0.304s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:46 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.info is being set with open permissions: ugo+rw Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:46 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.info Sep 17 23:45:46 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:46 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.info" returned: 0 in 0.268s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] snapshot: 771cd981-56a5-4087-983c-bd701658a11e, volume: 84f9a66a-823f-4b2c-9e07-cf4eb9e20479, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bbe291-5f97-43b2-8d7b-ef047ca0e1ce]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:46 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e Sep 17 23:45:46 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:47 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e" returned: 0 in 0.565s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30a0179-a645-4427-9fac-0baa4b1b30f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8f14a4-1d16-4fb5-aedb-4aef7d3dd829]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:47 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 Sep 17 23:45:47 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:47 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2" returned: 0 in 0.605s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:45:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:48 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 Sep 17 23:45:48 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Flow 'volume_create_manager' (0a98da75-c48f-4298-8e9f-e7d0f832aa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635df830-c01c-4b54-93e0-074455adb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635df830-c01c-4b54-93e0-074455adb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1546402401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3661a80-5fc6-4353-b765-058e018f68a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c533ae2879d6407080e1ea72d5b8d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:49Z,use_quota=True,user_id='022fc6db719b4ab9911960f574dc012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf890c1b-e2ab-4169-9307-31de4560bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf890c1b-e2ab-4169-9307-31de4560bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fe806a-40d4-4ce3-8724-e1d96a9e3056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fe806a-40d4-4ce3-8724-e1d96a9e3056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3661a80-5fc6-4353-b765-058e018f68a7', 'volume_name': 'volume-c3661a80-5fc6-4353-b765-058e018f68a7', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a3539-c232-4136-8be0-665e2f87887f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a3539-c232-4136-8be0-665e2f87887f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911b5d47-3f66-4682-bcff-f74b51fac813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:49 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Volume c3661a80-5fc6-4353-b765-058e018f68a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3661a80-5fc6-4353-b765-058e018f68a7', 'volume_size': 1} Sep 17 23:45:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:55 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" returned: 0 in 7.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:45:55 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Converted 1024.00 MB image at 139.00 MB/s Sep 17 23:45:55 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 is being set with open permissions: ugo+rw Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:55 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 Sep 17 23:45:55 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:55 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" returned: 0 in 0.252s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" released by "_copy_volume_from_snapshot" :: held 8.904s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=113,cinder:INSERT=49,cinder:UPDATE=154,cinder:DELETE=10 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-771cd981-56a5-4087-983c-bd701658a11e" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-771cd981-56a5-4087-983c-bd701658a11e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Deleting offline snapshot 771cd981-56a5-4087-983c-bd701658a11e of volume a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] snapshot_file for this snap is: volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3914e8-b359-4529-82c6-2c81ab7475ed]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:55 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e Sep 17 23:45:55 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:56 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e" returned: 0 in 0.453s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30a0179-a645-4427-9fac-0baa4b1b30f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:45:56 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa081b14-cef7-434f-97a3-65af942c374e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:45:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:56 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 Sep 17 23:45:56 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:56 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2" returned: 0 in 0.570s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:56 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e Sep 17 23:45:56 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:57 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e" returned: 0 in 0.432s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:57 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e Sep 17 23:45:57 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:57 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2.771cd981-56a5-4087-983c-bd701658a11e" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-771cd981-56a5-4087-983c-bd701658a11e" released by "_delete_snapshot" :: held 1.844s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=125,cinder:INSERT=46,cinder:UPDATE=143,cinder:DELETE=13 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.575s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.958s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f59c4476-6073-4f7c-be52-1f08b9edd441,created_at=2026-09-17T21:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246682408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f59c4476-6073-4f7c-be52-1f08b9edd441,host='devstack@QuobyteHD#QuobyteHD',id=ad052972-aead-4cc4-a2c2-c224c4310f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4777def592c4414083dafce7ea0ffc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:44Z,use_quota=True,user_id='968ba6dd0c8144e48db2b95ed4348eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4891551a-9e2c-41d8-89b1-e7e29655f3c8),volume_type_id=4891551a-9e2c-41d8-89b1-e7e29655f3c8)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Creating volume ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:57 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:57 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e 1073741824 Sep 17 23:45:57 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b406df-dc8f-43f8-80d2-3b3f4cb488c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479', 'volume_size': 1, 'source_volid': 'a30a0179-a645-4427-9fac-0baa4b1b30f2', 'source_volstatus': 'available'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf844eb-c5a7-4155-aaee-b07d36477832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:57 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Volume volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 (84f9a66a-823f-4b2c-9e07-cf4eb9e20479): created successfully Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf844eb-c5a7-4155-aaee-b07d36477832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (cfbff869-1c63-4382-9c2c-f99ab419e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c29471ed-6c03-4fee-b2a3-1cbb33a665f0 tempest-VolumesGetTest-782838041 None] Created volume successfully. Sep 17 23:45:57 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e 1073741824" returned: 0 in 0.444s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:58 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e Sep 17 23:45:58 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:58 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e" returned: 0 in 0.328s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.746s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1546402401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3661a80-5fc6-4353-b765-058e018f68a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c533ae2879d6407080e1ea72d5b8d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:49Z,use_quota=True,user_id='022fc6db719b4ab9911960f574dc012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Creating volume c3661a80-5fc6-4353-b765-058e018f68a7 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:58 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737dfc5b-ba5c-413d-8329-523c548b3c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad052972-aead-4cc4-a2c2-c224c4310f3e', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4be6879-9cb5-43b3-baa7-1497446c1501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:58 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 1073741824 Sep 17 23:45:58 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:58 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Volume volume-ad052972-aead-4cc4-a2c2-c224c4310f3e (ad052972-aead-4cc4-a2c2-c224c4310f3e): created successfully Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4be6879-9cb5-43b3-baa7-1497446c1501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Flow 'volume_create_manager' (00071c4f-674f-482c-9627-c97fb4ae6df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:58 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3aeb61e4-5278-40af-9bef-08b169bc2185 tempest-GroupSnapshotsV319Test-1316212412 None] Created volume successfully. Sep 17 23:45:59 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 1073741824" returned: 0 in 0.653s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:59 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 Sep 17 23:45:59 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (ce82a9b9-956b-4628-bbed-eaa2df86a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a334008-ac5d-4a8d-aeda-9e0095fe6f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a334008-ac5d-4a8d-aeda-9e0095fe6f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1975260611',display_name='tempest-VolumesGetTest-Volume-1939593427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2908990e-8f81-468c-8e49-bf5b8a2a2553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:59Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c6792a-2e6c-42f4-92ac-6996de699f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c6792a-2e6c-42f4-92ac-6996de699f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea156c91-2a5b-4b5e-80c5-45bc6e6edfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea156c91-2a5b-4b5e-80c5-45bc6e6edfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2908990e-8f81-468c-8e49-bf5b8a2a2553', 'volume_name': 'volume-2908990e-8f81-468c-8e49-bf5b8a2a2553', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab24e8c-9b0e-4e88-b84a-f0f08fa6612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab24e8c-9b0e-4e88-b84a-f0f08fa6612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a041001f-afea-4d98-a0f4-c972688d9991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Volume 2908990e-8f81-468c-8e49-bf5b8a2a2553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2908990e-8f81-468c-8e49-bf5b8a2a2553', 'volume_size': 1} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:59 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7" returned: 0 in 0.622s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:45:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1975260611',display_name='tempest-VolumesGetTest-Volume-1939593427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2908990e-8f81-468c-8e49-bf5b8a2a2553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:45:59Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Creating volume 2908990e-8f81-468c-8e49-bf5b8a2a2553 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:45:59 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:45:59 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 1073741824 Sep 17 23:45:59 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911b5d47-3f66-4682-bcff-f74b51fac813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3661a80-5fc6-4353-b765-058e018f68a7', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b90a020-d96e-450d-bc2e-8eaad4572d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:45:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Volume volume-c3661a80-5fc6-4353-b765-058e018f68a7 (c3661a80-5fc6-4353-b765-058e018f68a7): created successfully Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b90a020-d96e-450d-bc2e-8eaad4572d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:45:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Flow 'volume_create_manager' (0a98da75-c48f-4298-8e9f-e7d0f832aa73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:45:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f0b1b182-de66-4be0-bdad-208d0b0690c7 tempest-VolumesListTestJSON-533632939 None] Created volume successfully. Sep 17 23:46:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] GroupSnapshot 72cab45a-62a6-4974-921c-2c9f672ce728: creating. Sep 17 23:46:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Group snapshot 72cab45a-62a6-4974-921c-2c9f672ce728: creating. {{(pid=85956) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 23:46:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:00 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 1073741824" returned: 0 in 0.857s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:00 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 Sep 17 23:46:00 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:01 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553" returned: 0 in 0.371s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.683s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a041001f-afea-4d98-a0f4-c972688d9991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2908990e-8f81-468c-8e49-bf5b8a2a2553', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83aa364-f738-4ab5-82c9-82fb4cee8fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Creating offline snapshot b56b0e05-c7e0-46ee-8100-569fc89bcbca of volume ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:46:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Volume volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 (2908990e-8f81-468c-8e49-bf5b8a2a2553): created successfully Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83aa364-f738-4ab5-82c9-82fb4cee8fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (ce82a9b9-956b-4628-bbed-eaa2df86a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1ac804-cd73-44ab-a139-9913f292da2f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-01d13a26-2e81-45b0-b22c-168f1eb9afe1 tempest-VolumesGetTest-782838041 None] Created volume successfully. Sep 17 23:46:01 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e Sep 17 23:46:01 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Flow 'volume_create_manager' (689e6b18-ec64-46bf-acbe-31a9317063cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49e3abb-62a9-4a82-8d95-021c04f81bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49e3abb-62a9-4a82-8d95-021c04f81bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1120592584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b726ee5e-8822-48ec-afa5-062e6ad38894,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c533ae2879d6407080e1ea72d5b8d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:01Z,use_quota=True,user_id='022fc6db719b4ab9911960f574dc012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef810881-5e9f-4254-a677-2f36e806d702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef810881-5e9f-4254-a677-2f36e806d702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de531e18-f04e-4993-a5e9-db2edcdf453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de531e18-f04e-4993-a5e9-db2edcdf453d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b726ee5e-8822-48ec-afa5-062e6ad38894', 'volume_name': 'volume-b726ee5e-8822-48ec-afa5-062e6ad38894', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386311ee-0608-4d1f-bf82-3192e96c7b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386311ee-0608-4d1f-bf82-3192e96c7b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b9cd6e-b7b8-435d-8afb-476be317dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Volume b726ee5e-8822-48ec-afa5-062e6ad38894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b726ee5e-8822-48ec-afa5-062e6ad38894', 'volume_size': 1} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-2908990e-8f81-468c-8e49-bf5b8a2a2553-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Lock "cinder-2908990e-8f81-468c-8e49-bf5b8a2a2553-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-2908990e-8f81-468c-8e49-bf5b8a2a2553" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-2908990e-8f81-468c-8e49-bf5b8a2a2553" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:01 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e" returned: 0 in 0.605s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4413e4-0f11-4b86-a06f-cf71cfa87b16]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:01 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca 1G Sep 17 23:46:01 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:01 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 Sep 17 23:46:01 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:02 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553" returned: 0 in 0.448s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:02 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553 Sep 17 23:46:02 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:02 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca 1G" returned: 0 in 0.522s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad052972-aead-4cc4-a2c2-c224c4310f3e -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:02 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad052972-aead-4cc4-a2c2-c224c4310f3e -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca Sep 17 23:46:02 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:02 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2908990e-8f81-468c-8e49-bf5b8a2a2553" returned: 0 in 0.311s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-2908990e-8f81-468c-8e49-bf5b8a2a2553" released by "delete_volume" :: held 0.832s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Created reservations ['fcbeb701-765c-4873-b927-2b6ed2f3d1fc', '6092ba91-6584-4ba1-ac27-40563419b63b', 'f21bd2ab-e687-4332-b887-3db08b15cc30', 'fcc07e98-0b90-4895-b168-d58b19136a22'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:02 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad052972-aead-4cc4-a2c2-c224c4310f3e -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca" returned: 0 in 0.372s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:02 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:02 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca Sep 17 23:46:02 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:02 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:02 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:03 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-84f9a66a-823f-4b2c-9e07-cf4eb9e20479-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca" returned: 0 in 0.490s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:03 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Lock "cinder-84f9a66a-823f-4b2c-9e07-cf4eb9e20479-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Deleted volume successfully. Sep 17 23:46:03 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.info Sep 17 23:46:03 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d39ee57c-78b7-4ec4-8009-d5cdadeb4fef tempest-VolumesGetTest-782838041 None] Lock "cinder-2908990e-8f81-468c-8e49-bf5b8a2a2553-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" acquired by "delete_volume" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b474d-bb5c-4f51-af45-8bd56e030351]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:03 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 Sep 17 23:46:03 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:03 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.info" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:03 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:03 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.info Sep 17 23:46:03 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:03 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.info" returned: 0 in 0.313s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.529s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1120592584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b726ee5e-8822-48ec-afa5-062e6ad38894,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c533ae2879d6407080e1ea72d5b8d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:01Z,use_quota=True,user_id='022fc6db719b4ab9911960f574dc012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Creating volume b726ee5e-8822-48ec-afa5-062e6ad38894 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:04 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:04 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" returned: 0 in 0.582s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:04 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 1073741824 Sep 17 23:46:04 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:04 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479 Sep 17 23:46:04 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-67a041a6-8fff-442a-87d5-f6365411c2c0 tempest-GroupSnapshotsV319Test-1316212412 None] group_snapshot 72cab45a-62a6-4974-921c-2c9f672ce728: created successfully Sep 17 23:46:04 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" returned: 0 in 0.480s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-84f9a66a-823f-4b2c-9e07-cf4eb9e20479" released by "delete_volume" :: held 1.149s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Created reservations ['629c9566-c52e-4235-9af8-55e21715af85', '93091703-b343-4319-9e3b-b46134ccda68', 'e16448d9-b1f2-43b0-ab1a-0c0fc050b128', 'd574efdc-987b-4fc1-b307-068e77ec068e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:04 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:04 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:04 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 1073741824" returned: 0 in 0.864s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:05 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 Sep 17 23:46:05 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:05 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.410s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Deleted volume successfully. Sep 17 23:46:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] group_snapshot 72cab45a-62a6-4974-921c-2c9f672ce728: deleting Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-81736723-55e2-4ed0-ac86-c5762aea49df tempest-VolumesGetTest-782838041 None] Lock "cinder-84f9a66a-823f-4b2c-9e07-cf4eb9e20479-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] group_snapshot 72cab45a-62a6-4974-921c-2c9f672ce728: deleting {{(pid=85956) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Acquiring lock "cinder-quobyte-ad052972-aead-4cc4-a2c2-c224c4310f3e" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Lock "cinder-quobyte-ad052972-aead-4cc4-a2c2-c224c4310f3e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Acquiring lock "cinder-quobyte-b56b0e05-c7e0-46ee-8100-569fc89bcbca" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Lock "cinder-quobyte-b56b0e05-c7e0-46ee-8100-569fc89bcbca" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Deleting offline snapshot b56b0e05-c7e0-46ee-8100-569fc89bcbca of volume ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] snapshot_file for this snap is: volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ab1967-22b1-47ce-81c3-9bd51f9e534e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:05 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894" returned: 0 in 0.667s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-a30a0179-a645-4427-9fac-0baa4b1b30f2-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b9cd6e-b7b8-435d-8afb-476be317dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b726ee5e-8822-48ec-afa5-062e6ad38894', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43adf8f0-71bf-4e06-be8c-c090cebe95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:05 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca Sep 17 23:46:05 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Lock "cinder-a30a0179-a645-4427-9fac-0baa4b1b30f2-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:05 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Volume volume-b726ee5e-8822-48ec-afa5-062e6ad38894 (b726ee5e-8822-48ec-afa5-062e6ad38894): created successfully Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43adf8f0-71bf-4e06-be8c-c090cebe95b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Flow 'volume_create_manager' (689e6b18-ec64-46bf-acbe-31a9317063cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-eaab0f1f-5d00-4807-bd6c-50daff8842af tempest-VolumesListTestJSON-533632939 None] Created volume successfully. Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-a30a0179-a645-4427-9fac-0baa4b1b30f2" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-a30a0179-a645-4427-9fac-0baa4b1b30f2" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caee9e4-1e0a-4314-844c-823d1902d14e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:06 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 Sep 17 23:46:06 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:06 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca" returned: 0 in 0.565s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad052972-aead-4cc4-a2c2-c224c4310f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1068fc66-828f-48be-97e2-c4661d78f075]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:06 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e Sep 17 23:46:06 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:06 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2" returned: 0 in 0.401s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:06 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2 Sep 17 23:46:06 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:06 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e" returned: 0 in 0.415s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:06 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca Sep 17 23:46:06 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:06 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a30a0179-a645-4427-9fac-0baa4b1b30f2" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-a30a0179-a645-4427-9fac-0baa4b1b30f2" released by "delete_volume" :: held 0.743s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Created reservations ['cb97f02c-2428-404e-9c31-2b025c6acff5', 'e825cbc5-e9c1-4b3c-b09e-56e3e8f53cf3', '5554fad3-d57f-424b-978b-9849a6c94b9c', '2bfc1f0a-cc14-4241-b2f4-f2f985265b8d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:06 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:06 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:07 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca" returned: 0 in 0.536s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:07 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca Sep 17 23:46:07 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:07 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.450s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:07 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Deleted volume successfully. Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f4c8c3db-09db-49cc-98c2-457f41a338bc tempest-VolumesGetTest-782838041 None] Lock "cinder-a30a0179-a645-4427-9fac-0baa4b1b30f2-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Flow 'volume_create_manager' (b3b28fee-ea80-475b-b2a0-0a2a5daae1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9148c20-593a-40e2-ba61-c8044520118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9148c20-593a-40e2-ba61-c8044520118a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-160159210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c17665-c061-4718-9989-22c5b1b1aff9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c533ae2879d6407080e1ea72d5b8d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:07Z,use_quota=True,user_id='022fc6db719b4ab9911960f574dc012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:07 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625cb063-ff21-4fb3-81d8-462bdb5af7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625cb063-ff21-4fb3-81d8-462bdb5af7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a10c38-110c-4fa8-9d3a-a5442396cbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a10c38-110c-4fa8-9d3a-a5442396cbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c17665-c061-4718-9989-22c5b1b1aff9', 'volume_name': 'volume-e5c17665-c061-4718-9989-22c5b1b1aff9', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbbf6d5-ca82-42fa-ab39-26614f273d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbbf6d5-ca82-42fa-ab39-26614f273d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9101e8ed-02b0-4fc5-b7a5-19c2d42d8681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:07 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Volume e5c17665-c061-4718-9989-22c5b1b1aff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c17665-c061-4718-9989-22c5b1b1aff9', 'volume_size': 1} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-160159210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c17665-c061-4718-9989-22c5b1b1aff9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c533ae2879d6407080e1ea72d5b8d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:07Z,use_quota=True,user_id='022fc6db719b4ab9911960f574dc012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Creating volume e5c17665-c061-4718-9989-22c5b1b1aff9 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:07 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e.b56b0e05-c7e0-46ee-8100-569fc89bcbca" returned: 0 in 0.482s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:07 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 1073741824 Sep 17 23:46:07 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Lock "cinder-quobyte-b56b0e05-c7e0-46ee-8100-569fc89bcbca" released by "_delete_snapshot" :: held 2.167s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Lock "cinder-quobyte-ad052972-aead-4cc4-a2c2-c224c4310f3e" released by "delete_snapshot" :: held 2.209s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:07 devstack cinder-volume[85956]: WARNING cinder.quota [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1036400775 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1036400775, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:46:07 devstack cinder-volume[85956]: WARNING cinder.quota [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1036400775 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1036400775, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:46:07 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] Created reservations ['123d5cf3-0135-4284-874e-cd4411c3a196', '979ea60c-65f7-4e4d-8a0f-f6df3d885aeb', '14636883-0212-4ec4-8322-2395b7589fa9', '4a280201-e0fd-43b3-b1dd-e6c0e57924e1'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:07 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7d7c6f7a-798a-45ef-9911-344251efd8cd tempest-GroupSnapshotsV319Test-1316212412 None] group_snapshot 72cab45a-62a6-4974-921c-2c9f672ce728: deleted successfully Sep 17 23:46:08 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 1073741824" returned: 0 in 0.730s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Acquiring lock "cinder-quobyte-ad052972-aead-4cc4-a2c2-c224c4310f3e" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "cinder-quobyte-ad052972-aead-4cc4-a2c2-c224c4310f3e" acquired by "delete_volume" :: waited 0.057s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:08 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 Sep 17 23:46:08 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[56457993-dd98-43ee-9a7a-90aa2978967e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:08 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e Sep 17 23:46:08 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:08 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9" returned: 0 in 0.447s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9101e8ed-02b0-4fc5-b7a5-19c2d42d8681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c17665-c061-4718-9989-22c5b1b1aff9', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3667ed62-48a3-4e0f-8b3d-9498f2d45c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:08 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Volume volume-e5c17665-c061-4718-9989-22c5b1b1aff9 (e5c17665-c061-4718-9989-22c5b1b1aff9): created successfully Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3667ed62-48a3-4e0f-8b3d-9498f2d45c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Flow 'volume_create_manager' (b3b28fee-ea80-475b-b2a0-0a2a5daae1bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a4b6a55f-e484-4c28-8b85-e68c421b2fb6 tempest-VolumesListTestJSON-533632939 None] Created volume successfully. Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:08 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (d51690e7-db8b-4eab-96b6-c5009d682c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e36a237-e6c2-4459-b1ba-2449d943ec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e" returned: 0 in 0.480s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:08 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e36a237-e6c2-4459-b1ba-2449d943ec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129440721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3471078d-baf6-484d-a72d-b3bf72680fac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:09Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:08 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb391c5e-3c09-4c11-8fc7-bf369c8ec34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb391c5e-3c09-4c11-8fc7-bf369c8ec34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727d3f09-b0c3-48f8-a2ce-ecb019bbd565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:08 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727d3f09-b0c3-48f8-a2ce-ecb019bbd565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3471078d-baf6-484d-a72d-b3bf72680fac', 'volume_name': 'volume-3471078d-baf6-484d-a72d-b3bf72680fac', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0c0cf8-d010-496f-baa2-a66c905e2c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:09 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0c0cf8-d010-496f-baa2-a66c905e2c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c14876-c610-473b-a3f6-22096a960470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:09 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Volume 3471078d-baf6-484d-a72d-b3bf72680fac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3471078d-baf6-484d-a72d-b3bf72680fac', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Trying to clone 3471078d-baf6-484d-a72d-b3bf72680fac from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ad052972-aead-4cc4-a2c2-c224c4310f3e" returned: 0 in 0.318s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "cinder-quobyte-ad052972-aead-4cc4-a2c2-c224c4310f3e" released by "delete_volume" :: held 0.909s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Created reservations ['49a8b669-1a09-4fdf-b08e-ef58983c7e6a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:09 devstack cinder-volume[85956]: WARNING cinder.quota [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1036400775 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1036400775, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Created reservations ['fd516520-6838-4501-88b3-578eab5ca60d', '456f4ce9-3573-481a-8e8c-31dfc0170853', 'd2af61df-91fe-4e33-b7bc-f9f9bacbfd45', 'c5b84a26-18fa-4b3a-a9c5-7db45913e064'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:46:09 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Image download 20.69 MB at 20.69 MB/s Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[560b26b3-7d85-4482-900b-dc6a66dfab38]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:09 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD Sep 17 23:46:09 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:09 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:09 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:10 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee is fetched for user d6337e9d6a314150835f955c42887e05. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6cbb83-6a07-446b-a94e-25d3e5c62809]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:10 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.538s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7d5faff8-c99f-497e-b80a-c054dd795f36 tempest-GroupSnapshotsV319Test-1316212412 None] Delete group completed successfully. Sep 17 23:46:10 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD Sep 17 23:46:10 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:10 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129440721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3471078d-baf6-484d-a72d-b3bf72680fac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:09Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Creating volume 3471078d-baf6-484d-a72d-b3bf72680fac {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:10 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:10 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac 1073741824 Sep 17 23:46:10 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:11 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac 1073741824" returned: 0 in 0.677s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:11 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac Sep 17 23:46:11 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:12 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac" returned: 0 in 0.408s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Attempting download of ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 3471078d-baf6-484d-a72d-b3bf72680fac. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac1d29-a418-4a07-92be-80e9a16d533f]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_rpwe_bjc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:12 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_rpwe_bjc Sep 17 23:46:12 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:12 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_rpwe_bjc" returned: 0 in 0.380s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_rpwe_bjc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:12 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_rpwe_bjc Sep 17 23:46:12 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Acquiring lock "cinder-e5c17665-c061-4718-9989-22c5b1b1aff9-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Lock "cinder-e5c17665-c061-4718-9989-22c5b1b1aff9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Acquiring lock "cinder-quobyte-e5c17665-c061-4718-9989-22c5b1b1aff9" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Lock "cinder-quobyte-e5c17665-c061-4718-9989-22c5b1b1aff9" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46ba422-3026-4659-9946-e9f2e8ba0eac]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:12 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_rpwe_bjc" returned: 1 in 0.453s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_rpwe_bjc' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:46:12 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0dd838-9f28-4ea8-8895-283eae753c45]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:13 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 Sep 17 23:46:13 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:13 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD Sep 17 23:46:13 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:13 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9" returned: 0 in 0.526s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:13 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9 Sep 17 23:46:13 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:13 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] ecf291a3-5fd0-40b6-8d63-9625bdc973ee was qcow2, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:13 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac Sep 17 23:46:13 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:13 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5c17665-c061-4718-9989-22c5b1b1aff9" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Lock "cinder-quobyte-e5c17665-c061-4718-9989-22c5b1b1aff9" released by "delete_volume" :: held 0.894s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Created reservations ['67a148ed-5ecc-4d42-a277-526947315eae', '538a664a-37f8-43c3-af5f-8e245995f632', 'bb641e93-5f24-42bf-900d-90bfc300acad', 'e3add955-b419-4a78-9df2-cc8069f54d3e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:13 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:13 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "cinder-b726ee5e-8822-48ec-afa5-062e6ad38894-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-b726ee5e-8822-48ec-afa5-062e6ad38894-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "cinder-quobyte-b726ee5e-8822-48ec-afa5-062e6ad38894" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-quobyte-b726ee5e-8822-48ec-afa5-062e6ad38894" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:14 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.345s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Deleted volume successfully. Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118e318-4677-4fd9-bea8-dd0ab65e1925]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92e5ef82-9244-496c-aeee-e07f0b48ee3a tempest-VolumesListTestJSON-533632939 None] Lock "cinder-e5c17665-c061-4718-9989-22c5b1b1aff9-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:14 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 Sep 17 23:46:14 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:14 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:14 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894 Sep 17 23:46:14 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:15 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b726ee5e-8822-48ec-afa5-062e6ad38894" returned: 0 in 0.309s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-quobyte-b726ee5e-8822-48ec-afa5-062e6ad38894" released by "delete_volume" :: held 0.852s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Created reservations ['3c76ad99-c011-4cd8-a08d-a4ce1480c1f4', '7901e64d-5eff-4e83-b23d-f96fdc8e86e5', 'bc7c6597-dabb-4d86-9d24-cb768d78afeb', '62a00d90-1511-4ad7-bae4-29c6f71f32fa'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:15 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:15 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "cinder-c3661a80-5fc6-4353-b765-058e018f68a7-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-c3661a80-5fc6-4353-b765-058e018f68a7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:15 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.325s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Deleted volume successfully. Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "cinder-quobyte-c3661a80-5fc6-4353-b765-058e018f68a7" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c63e19a8-eb79-4213-8c63-017e09d0cc49 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-b726ee5e-8822-48ec-afa5-062e6ad38894-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-quobyte-c3661a80-5fc6-4353-b765-058e018f68a7" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04306e-c8df-47ed-8a21-2d4f1485daed]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:15 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 Sep 17 23:46:15 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:15 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac" returned: 0 in 2.425s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_g_1878z9devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:46:15 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Converted 112.00 MB image at 46.16 MB/s Sep 17 23:46:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:15 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac 1G Sep 17 23:46:15 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:16 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7" returned: 0 in 0.403s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:16 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7 Sep 17 23:46:16 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:16 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac 1G" returned: 0 in 0.347s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Downloaded image ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 3471078d-baf6-484d-a72d-b3bf72680fac successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee for user d6337e9d6a314150835f955c42887e05 is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Marking volume 3471078d-baf6-484d-a72d-b3bf72680fac as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Copying metadata from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee to 3471078d-baf6-484d-a72d-b3bf72680fac. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Creating volume glance metadata for volume 3471078d-baf6-484d-a72d-b3bf72680fac backed by image ecf291a3-5fd0-40b6-8d63-9625bdc973ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:46:16 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c3661a80-5fc6-4353-b765-058e018f68a7" returned: 0 in 0.284s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-quobyte-c3661a80-5fc6-4353-b765-058e018f68a7" released by "delete_volume" :: held 0.752s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Created reservations ['da65a70f-d059-4f99-a267-2a5d7b163b2c', '59d0e574-da8b-4ddd-a590-d54a2edd954e', 'e8aaa015-2b0a-49d6-b770-56fe0415809e', 'f9f6978a-4d1c-4b87-84c9-b4819fc4c52c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c14876-c610-473b-a3f6-22096a960470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3471078d-baf6-484d-a72d-b3bf72680fac', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269c6afa-4e73-45ce-af4f-145f2f120a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:16 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Volume volume-3471078d-baf6-484d-a72d-b3bf72680fac (3471078d-baf6-484d-a72d-b3bf72680fac): created successfully Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269c6afa-4e73-45ce-af4f-145f2f120a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (d51690e7-db8b-4eab-96b6-c5009d682c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2bd93308-c5b3-40b5-bc64-c2227ff5daec tempest-VolumesGetTest-782838041 None] Created volume successfully. Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:16 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:16 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:16 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Deleted volume successfully. Sep 17 23:46:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27cb7a09-c293-434f-b419-6992b20ecd04 tempest-VolumesListTestJSON-533632939 None] Lock "cinder-c3661a80-5fc6-4353-b765-058e018f68a7-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (56d2bcb2-8e1b-4ad2-8951-d416de32cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef0cbdf-209e-4c0a-98f7-8c9c75407df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef0cbdf-209e-4c0a-98f7-8c9c75407df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-386648055',display_name='tempest-VolumesGetTest-Volume-1713090869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c49f5d8-2155-4d02-956b-26742b65e161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:18Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc89be98-f5f3-46dd-b4df-d9f39f589dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc89be98-f5f3-46dd-b4df-d9f39f589dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7903c13b-be94-4859-b16a-db4e4d7a8061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7903c13b-be94-4859-b16a-db4e4d7a8061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c49f5d8-2155-4d02-956b-26742b65e161', 'volume_name': 'volume-7c49f5d8-2155-4d02-956b-26742b65e161', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81258068-f9ee-4d16-8c00-895d47691d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81258068-f9ee-4d16-8c00-895d47691d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d042baf-1518-409c-ac51-c83047efa5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:18 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Volume 7c49f5d8-2155-4d02-956b-26742b65e161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c49f5d8-2155-4d02-956b-26742b65e161', 'volume_size': 1} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-386648055',display_name='tempest-VolumesGetTest-Volume-1713090869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c49f5d8-2155-4d02-956b-26742b65e161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de883ad6304c118a331873ad2ea858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:18Z,use_quota=True,user_id='d6337e9d6a314150835f955c42887e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Creating volume 7c49f5d8-2155-4d02-956b-26742b65e161 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:18 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:18 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 1073741824 Sep 17 23:46:18 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:18 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 1073741824" returned: 0 in 0.506s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:19 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 Sep 17 23:46:19 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:19 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d042baf-1518-409c-ac51-c83047efa5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c49f5d8-2155-4d02-956b-26742b65e161', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c24771-1722-4e69-b4a4-81c3246e8af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:19 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Volume volume-7c49f5d8-2155-4d02-956b-26742b65e161 (7c49f5d8-2155-4d02-956b-26742b65e161): created successfully Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c24771-1722-4e69-b4a4-81c3246e8af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Flow 'volume_create_manager' (56d2bcb2-8e1b-4ad2-8951-d416de32cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-02146ea7-d358-4224-bdd7-a95255313482 tempest-VolumesGetTest-782838041 None] Created volume successfully. Sep 17 23:46:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-7c49f5d8-2155-4d02-956b-26742b65e161-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Lock "cinder-7c49f5d8-2155-4d02-956b-26742b65e161-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:20 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:20 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Flow 'volume_create_manager' (43f13eee-75cc-46c6-ad70-99e2e8e69e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:20 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211b004b-7f2c-4ad5-91d6-ae6fe645d409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-7c49f5d8-2155-4d02-956b-26742b65e161" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211b004b-7f2c-4ad5-91d6-ae6fe645d409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1167551354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321e70d6-64e9-419b-91dd-61b010bd8150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa41960e1fe4825bf580d1adf565dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:21Z,use_quota=True,user_id='0961696a1d3e49bb873ea5b123c43255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca18b19f-38a3-4ab0-a05d-80ae1c01e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca18b19f-38a3-4ab0-a05d-80ae1c01e783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d62be9-bde0-44bf-91cc-6ff852284bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d62be9-bde0-44bf-91cc-6ff852284bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321e70d6-64e9-419b-91dd-61b010bd8150', 'volume_name': 'volume-321e70d6-64e9-419b-91dd-61b010bd8150', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33d1ffe-d640-4c34-914d-9b7a54749e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33d1ffe-d640-4c34-914d-9b7a54749e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591f0b83-ba46-40a5-b0b1-27276e5b4e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:21 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Volume 321e70d6-64e9-419b-91dd-61b010bd8150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321e70d6-64e9-419b-91dd-61b010bd8150', 'volume_size': 1} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1167551354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321e70d6-64e9-419b-91dd-61b010bd8150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa41960e1fe4825bf580d1adf565dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:21Z,use_quota=True,user_id='0961696a1d3e49bb873ea5b123c43255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Creating volume 321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:21 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-7c49f5d8-2155-4d02-956b-26742b65e161" acquired by "delete_volume" :: waited 0.097s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:21 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 1073741824 Sep 17 23:46:21 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f489a7-647a-4ba9-a7e5-40f43a740d79]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:21 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 Sep 17 23:46:21 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:21 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161" returned: 0 in 0.483s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:21 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161 Sep 17 23:46:21 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:21 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 1073741824" returned: 0 in 0.659s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:21 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 Sep 17 23:46:21 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:22 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7c49f5d8-2155-4d02-956b-26742b65e161" returned: 0 in 0.398s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-7c49f5d8-2155-4d02-956b-26742b65e161" released by "delete_volume" :: held 0.976s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Created reservations ['1302e7f8-754e-43f7-a40e-11caa5726e81', '04734485-071f-4841-8681-13927ed82afa', '294b31cf-5618-4ce3-ade4-da419308ccc7', '0a2c6ad1-7ba8-4982-bde5-de563c4bc569'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:22 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150" returned: 0 in 0.346s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591f0b83-ba46-40a5-b0b1-27276e5b4e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321e70d6-64e9-419b-91dd-61b010bd8150', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d04c29a-fd21-4512-a958-c2a97157b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Volume volume-321e70d6-64e9-419b-91dd-61b010bd8150 (321e70d6-64e9-419b-91dd-61b010bd8150): created successfully Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d04c29a-fd21-4512-a958-c2a97157b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Flow 'volume_create_manager' (43f13eee-75cc-46c6-ad70-99e2e8e69e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2320a3c9-bc67-40c0-bff2-3d9a8ae73980 tempest-VolumesSnapshotListTestJSON-1241567231 None] Created volume successfully. Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:22 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:22 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:22 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.274s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Deleted volume successfully. Sep 17 23:46:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f64d5f13-7488-4af9-885d-d31486fb7c88 tempest-VolumesGetTest-782838041 None] Lock "cinder-7c49f5d8-2155-4d02-956b-26742b65e161-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Creating offline snapshot 404fb12f-7a95-4985-a54c-659ea4a857be of volume 321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d231e7-455d-4eba-8075-4d9fff667e39]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-3471078d-baf6-484d-a72d-b3bf72680fac-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Lock "cinder-3471078d-baf6-484d-a72d-b3bf72680fac-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Acquiring lock "cinder-quobyte-3471078d-baf6-484d-a72d-b3bf72680fac" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-3471078d-baf6-484d-a72d-b3bf72680fac" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e12524-f788-4ab0-adc2-fc669bc5e398]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:23 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 Sep 17 23:46:23 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:23 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac Sep 17 23:46:23 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:23 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150" returned: 0 in 0.479s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:23 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be 1G Sep 17 23:46:23 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:23 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac" returned: 0 in 0.459s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:24 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac Sep 17 23:46:24 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:24 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3471078d-baf6-484d-a72d-b3bf72680fac" returned: 0 in 0.314s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Lock "cinder-quobyte-3471078d-baf6-484d-a72d-b3bf72680fac" released by "delete_volume" :: held 0.841s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:24 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be 1G" returned: 0 in 0.516s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:24 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be Sep 17 23:46:24 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Created reservations ['387b11ce-2157-426d-9341-9458bd58a777', 'e3410ee4-c77e-4f83-956f-ac0c9220f1bf', '383d0e25-54fe-43d4-9726-8ba0232765e3', 'a5f4c7dd-a484-4509-a551-5df4951b3025'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:24 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:24 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:24 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:24 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be is being set with open permissions: ugo+rw Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:24 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be Sep 17 23:46:24 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:24 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.428s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:24 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Deleted volume successfully. Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-089d6734-9816-443a-8d56-da86342356c7 tempest-VolumesGetTest-782838041 None] Lock "cinder-3471078d-baf6-484d-a72d-b3bf72680fac-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:25 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be" returned: 0 in 0.342s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:25 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.info Sep 17 23:46:25 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Flow 'volume_create_manager' (68e68d21-89ca-43ef-949e-5379570ff956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87afb1ef-f2cf-4954-a6cc-3bd42b67d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87afb1ef-f2cf-4954-a6cc-3bd42b67d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2080250698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fcbf53-0827-4381-a02f-608dc9930a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed59ce6b2c90467982478cc4d851b86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:25Z,use_quota=True,user_id='7a16d9c6d2a148978b94be4106bae2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16202943-aea8-41f9-a63a-a892f630c9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16202943-aea8-41f9-a63a-a892f630c9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c2fab6-2314-4a4c-ba0c-903a64cba0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c2fab6-2314-4a4c-ba0c-903a64cba0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73fcbf53-0827-4381-a02f-608dc9930a7a', 'volume_name': 'volume-73fcbf53-0827-4381-a02f-608dc9930a7a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccf61f-6130-4e2e-941f-835d2cb2a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccf61f-6130-4e2e-941f-835d2cb2a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da637a9a-3a4c-477d-a011-9e489f0152ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:25 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Volume 73fcbf53-0827-4381-a02f-608dc9930a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73fcbf53-0827-4381-a02f-608dc9930a7a', 'volume_size': 1} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:25 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.info" returned: 0 in 0.343s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:25 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.info is being set with open permissions: ugo+rw Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:25 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.info Sep 17 23:46:25 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0471fafb-bd20-4d09-b165-9b650814d269 tempest-GroupsV314Test-892268517 None] Group tempest-GroupsV314Test-Group-925834783: creating Sep 17 23:46:25 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.info" returned: 0 in 0.295s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2080250698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fcbf53-0827-4381-a02f-608dc9930a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed59ce6b2c90467982478cc4d851b86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:25Z,use_quota=True,user_id='7a16d9c6d2a148978b94be4106bae2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Creating volume 73fcbf53-0827-4381-a02f-608dc9930a7a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:25 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:25 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a 1073741824 Sep 17 23:46:25 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-34f9d26b-b0d5-4863-b2d1-525c0a85a4d3 tempest-VolumesSnapshotListTestJSON-1241567231 None] Create snapshot completed successfully Sep 17 23:46:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0471fafb-bd20-4d09-b165-9b650814d269 tempest-GroupsV314Test-892268517 None] Group tempest-GroupsV314Test-Group-925834783: created successfully Sep 17 23:46:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0471fafb-bd20-4d09-b165-9b650814d269 tempest-GroupsV314Test-892268517 None] Create group completed successfully. Sep 17 23:46:26 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a 1073741824" returned: 0 in 0.511s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:26 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a Sep 17 23:46:26 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:26 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a" returned: 0 in 0.292s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da637a9a-3a4c-477d-a011-9e489f0152ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73fcbf53-0827-4381-a02f-608dc9930a7a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05a0c96-a675-4a65-8ee3-2323a50c380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Creating offline snapshot 541592f9-7a0c-4fdf-8374-b0775bde72f0 of volume 321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:46:26 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Volume volume-73fcbf53-0827-4381-a02f-608dc9930a7a (73fcbf53-0827-4381-a02f-608dc9930a7a): created successfully Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05a0c96-a675-4a65-8ee3-2323a50c380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Flow 'volume_create_manager' (68e68d21-89ca-43ef-949e-5379570ff956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cd53d2-e2ec-4954-9368-3a15ab94ac4e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f9fd0570-b92f-416a-bb66-795df1b4678e tempest-AttachVolumeShelveTestJSON-1865294574 None] Created volume successfully. Sep 17 23:46:26 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be Sep 17 23:46:26 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:27 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be" returned: 0 in 0.464s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e70d6-64e9-419b-91dd-61b010bd8150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:27 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 1G Sep 17 23:46:27 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Flow 'volume_create_manager' (b4a0836c-ae5d-4ba5-a937-3f307bc7c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a470825-b535-4b98-9e24-97b15bdb62b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a470825-b535-4b98-9e24-97b15bdb62b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023258032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c40b7489-9525-446a-9435-232f74801b39,host='devstack@QuobyteHD#QuobyteHD',id=b720bf31-c96b-4ee8-985e-1cc73f1ddc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08ce5636bf484bb898ef5432499b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:28Z,use_quota=True,user_id='2c0927ce1b6d492594fc5613fe672560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48f85c87-7cf1-4d10-880f-bbb3349fad47),volume_type_id=48f85c87-7cf1-4d10-880f-bbb3349fad47)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a16b0a1-89bf-469f-b9c4-4ab637b17517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a16b0a1-89bf-469f-b9c4-4ab637b17517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7355f6-d1fe-49d5-8d16-df727241d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7355f6-d1fe-49d5-8d16-df727241d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b720bf31-c96b-4ee8-985e-1cc73f1ddc69', 'volume_name': 'volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bf410a-4ffa-418a-8239-760ebd6875fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bf410a-4ffa-418a-8239-760ebd6875fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4d4802-0d91-4bb1-a306-29c7be0227a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:27 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Volume b720bf31-c96b-4ee8-985e-1cc73f1ddc69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69', 'volume_size': 1} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:27 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 1G" returned: 0 in 0.641s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:27 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 Sep 17 23:46:27 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:28 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0" returned: 0 in 0.349s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:28 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 is being set with open permissions: ugo+rw Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:28 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 Sep 17 23:46:28 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:28 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c40b7489-9525-446a-9435-232f74801b39,created_at=2026-09-17T21:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023258032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c40b7489-9525-446a-9435-232f74801b39,host='devstack@QuobyteHD#QuobyteHD',id=b720bf31-c96b-4ee8-985e-1cc73f1ddc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08ce5636bf484bb898ef5432499b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:28Z,use_quota=True,user_id='2c0927ce1b6d492594fc5613fe672560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48f85c87-7cf1-4d10-880f-bbb3349fad47),volume_type_id=48f85c87-7cf1-4d10-880f-bbb3349fad47)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Creating volume b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:28 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:28 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 1073741824 Sep 17 23:46:28 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c0d78934-3d3c-4b0e-9183-3956cc08226e tempest-VolumesSnapshotListTestJSON-1241567231 None] Create snapshot completed successfully Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Flow 'volume_create_manager' (aad9bcb7-8a21-4309-9b30-e968325f3d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:29 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab2e985-b954-4ef2-8983-5090944d0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 1073741824" returned: 0 in 0.659s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab2e985-b954-4ef2-8983-5090944d0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-10389178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a13ab4c-a7ff-4016-ab88-9fe0e2e348be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5cc56677e4ae4994c168c866c8db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:29Z,use_quota=True,user_id='711af59270d74b098dda855566f077a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31a95fa-878b-41d6-8596-907f8bee9b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31a95fa-878b-41d6-8596-907f8bee9b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea8b8ef-ac8e-412f-a189-e0651101e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea8b8ef-ac8e-412f-a189-e0651101e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a13ab4c-a7ff-4016-ab88-9fe0e2e348be', 'volume_name': 'volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c8ba94-581b-40d8-9991-2849836e7bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c8ba94-581b-40d8-9991-2849836e7bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d134420-353d-4d4a-8002-550e9ef96d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:29 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Volume 8a13ab4c-a7ff-4016-ab88-9fe0e2e348be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be', 'volume_size': 1} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:29 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 Sep 17 23:46:29 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:29 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" returned: 0 in 0.278s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-10389178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a13ab4c-a7ff-4016-ab88-9fe0e2e348be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5cc56677e4ae4994c168c866c8db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:46:29Z,use_quota=True,user_id='711af59270d74b098dda855566f077a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Creating volume 8a13ab4c-a7ff-4016-ab88-9fe0e2e348be {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:46:29 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:29 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be 1073741824 Sep 17 23:46:29 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4d4802-0d91-4bb1-a306-29c7be0227a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f417625-e1c7-4412-a13f-52ef0fc7f4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:29 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Volume volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 (b720bf31-c96b-4ee8-985e-1cc73f1ddc69): created successfully Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f417625-e1c7-4412-a13f-52ef0fc7f4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Flow 'volume_create_manager' (b4a0836c-ae5d-4ba5-a937-3f307bc7c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:29 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8f8e3c99-431a-4413-ad0a-7ab8fb27c018 tempest-GroupsV314Test-892268517 None] Created volume successfully. Sep 17 23:46:30 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be 1073741824" returned: 0 in 0.439s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:30 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be Sep 17 23:46:30 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:30 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be" returned: 0 in 0.345s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.133s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d134420-353d-4d4a-8002-550e9ef96d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99093a1-5932-4b91-a91b-c114cb67b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Creating offline snapshot 89f8b808-5db5-40ce-8e70-b81879c7f2b7 of volume 321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:46:30 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Volume volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be (8a13ab4c-a7ff-4016-ab88-9fe0e2e348be): created successfully Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99093a1-5932-4b91-a91b-c114cb67b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Flow 'volume_create_manager' (aad9bcb7-8a21-4309-9b30-e968325f3d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d6c23-9882-464b-a057-6532018b0fc5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:30 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-34c6280e-2eb8-44aa-9fa0-f692a5ea19fe tempest-VolumesNegativeTest-1451425477 None] Created volume successfully. Sep 17 23:46:30 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 Sep 17 23:46:30 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:31 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0" returned: 0 in 0.432s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e70d6-64e9-419b-91dd-61b010bd8150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:31 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 1G Sep 17 23:46:31 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:31 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 1G" returned: 0 in 0.589s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:31 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 Sep 17 23:46:31 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:32 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7" returned: 0 in 0.414s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:32 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 is being set with open permissions: ugo+rw Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:32 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 Sep 17 23:46:32 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:32 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7" returned: 0 in 0.340s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.574s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:32 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Cloning volume b720bf31-c96b-4ee8-985e-1cc73f1ddc69 to volume 2eee95fd-016d-4f53-b33d-3ae3867a1789 Sep 17 23:46:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2c0d99fc-b986-4137-92d0-7f51f996d178 tempest-VolumesSnapshotListTestJSON-1241567231 None] Create snapshot completed successfully Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Creating offline snapshot ab19a9c9-66d5-4e3d-98c8-024f18972ad2 of volume b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b07b6b-6374-4eef-a185-e7ac3095043e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:32 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 Sep 17 23:46:32 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:32 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:32 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 1G Sep 17 23:46:32 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:33 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 1G" returned: 0 in 0.741s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:33 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 Sep 17 23:46:33 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:34 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2" returned: 0 in 0.421s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:34 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:46:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:34 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 Sep 17 23:46:34 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:34 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2" returned: 0 in 0.512s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:34 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.info Sep 17 23:46:34 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-89f8b808-5db5-40ce-8e70-b81879c7f2b7-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-89f8b808-5db5-40ce-8e70-b81879c7f2b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-quobyte-89f8b808-5db5-40ce-8e70-b81879c7f2b7" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-89f8b808-5db5-40ce-8e70-b81879c7f2b7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Deleting offline snapshot 89f8b808-5db5-40ce-8e70-b81879c7f2b7 of volume 321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:46:35 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] snapshot_file for this snap is: volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.info" returned: 0 in 0.391s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:35 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b26dbd4-7b64-4657-b264-5dc1a10e716c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:35 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.info Sep 17 23:46:35 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:35 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 Sep 17 23:46:35 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:35 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.info" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Acquiring lock "cinder-quobyte-2eee95fd-016d-4f53-b33d-3ae3867a1789" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-2eee95fd-016d-4f53-b33d-3ae3867a1789" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] snapshot: ab19a9c9-66d5-4e3d-98c8-024f18972ad2, volume: 2eee95fd-016d-4f53-b33d-3ae3867a1789, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7a29c9-b860-44fb-9fa4-43854c2bc84c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:35 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7" returned: 0 in 0.504s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e70d6-64e9-419b-91dd-61b010bd8150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebed8f1c-6100-4cc5-b181-75da8004169a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:35 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 Sep 17 23:46:35 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:35 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 Sep 17 23:46:35 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:36 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2" returned: 0 in 0.805s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f3a55-31c8-4bf7-9dd9-41767ca05085]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:36 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0" returned: 0 in 0.777s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e70d6-64e9-419b-91dd-61b010bd8150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:36 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 Sep 17 23:46:36 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:36 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 Sep 17 23:46:36 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:36 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" returned: 0 in 0.503s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:36 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:36 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 Sep 17 23:46:36 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7" returned: 0 in 0.491s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:36 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7 Sep 17 23:46:36 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:37 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.89f8b808-5db5-40ce-8e70-b81879c7f2b7" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-89f8b808-5db5-40ce-8e70-b81879c7f2b7" released by "_delete_snapshot" :: held 2.207s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" released by "delete_snapshot" :: held 2.238s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:37 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Created reservations ['e7cf5b2a-d8d3-45f3-95c0-4c3c53fecf07', '6991fb4f-c8d4-4647-bfad-6f832e7f1e83', '236354d1-1465-4721-ac16-839d39d069f8', '743251a8-22f7-420a-b52e-7d4ec267622b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Delete snapshot completed successfully. Sep 17 23:46:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-390e9952-0103-43b2-9d34-ee673d5812cf tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-89f8b808-5db5-40ce-8e70-b81879c7f2b7-delete_snapshot" released by "delete_snapshot" :: held 2.470s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-541592f9-7a0c-4fdf-8374-b0775bde72f0-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-541592f9-7a0c-4fdf-8374-b0775bde72f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-quobyte-541592f9-7a0c-4fdf-8374-b0775bde72f0" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-541592f9-7a0c-4fdf-8374-b0775bde72f0" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Deleting offline snapshot 541592f9-7a0c-4fdf-8374-b0775bde72f0 of volume 321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] snapshot_file for this snap is: volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4399b3-5579-44b1-a6f4-84476737a0e4]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:39 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 Sep 17 23:46:39 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:40 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0" returned: 0 in 1.879s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e70d6-64e9-419b-91dd-61b010bd8150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:40 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c20db-6ff8-48dc-828f-2ad84fbd27eb]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:41 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be Sep 17 23:46:41 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:42 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-65e6bb90-e69d-4caf-b3c9-a1b25ab52231 req-eb3f624f-42fa-4079-ad45-04eb5538209e tempest-AttachVolumeShelveTestJSON-1865294574 None] No connector for attachment 878b7207-555e-47df-bb82-030b57345e7e; skipping storage backend terminate_connection call. {{(pid=85956) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-65e6bb90-e69d-4caf-b3c9-a1b25ab52231 req-eb3f624f-42fa-4079-ad45-04eb5538209e tempest-AttachVolumeShelveTestJSON-1865294574 None] Deleting attachment 878b7207-555e-47df-bb82-030b57345e7e. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:46:42 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:42 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be" returned: 0 in 1.805s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e70d6-64e9-419b-91dd-61b010bd8150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:42 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 Sep 17 23:46:42 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:43 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.995s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:43 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:43 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:46:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:46:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:46:43 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0" returned: 0 in 1.232s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:43 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0 Sep 17 23:46:43 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:44 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.541592f9-7a0c-4fdf-8374-b0775bde72f0" returned: 0 in 0.934s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-541592f9-7a0c-4fdf-8374-b0775bde72f0" released by "_delete_snapshot" :: held 6.363s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" released by "delete_snapshot" :: held 6.457s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:45 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Created reservations ['3970c5da-b0af-4b3e-80fb-5bd0b154f2dd', 'a4c3896b-c034-4fc1-99e8-3d8d0f4134f9', 'b3572fa4-5733-4a51-9201-745b2637f1cc', 'ef2370e8-0a37-4fcd-810d-3cb8342f9db7'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Delete snapshot completed successfully. Sep 17 23:46:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6c4aab28-385f-439a-ac96-bc53a0255843 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-541592f9-7a0c-4fdf-8374-b0775bde72f0-delete_snapshot" released by "delete_snapshot" :: held 7.028s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-404fb12f-7a95-4985-a54c-659ea4a857be-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-404fb12f-7a95-4985-a54c-659ea4a857be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-quobyte-404fb12f-7a95-4985-a54c-659ea4a857be" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-404fb12f-7a95-4985-a54c-659ea4a857be" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Deleting offline snapshot 404fb12f-7a95-4985-a54c-659ea4a857be of volume 321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] snapshot_file for this snap is: volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba6675e-071d-41ba-9769-be77d1d1b66e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:47 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be Sep 17 23:46:47 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:47 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be" returned: 0 in 1.120s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e70d6-64e9-419b-91dd-61b010bd8150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d76f71b-1698-48bc-b0e7-d8237a91ad5c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:48 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 Sep 17 23:46:48 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:48 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150" returned: 0 in 0.934s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:48 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be Sep 17 23:46:48 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:49 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789" returned: 0 in 12.318s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69, size 1024.00 MB, duration 12.32 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:46:49 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Converted 1024.00 MB image at 83.12 MB/s Sep 17 23:46:49 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:49 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 Sep 17 23:46:49 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:49 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be" returned: 0 in 0.509s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:49 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be Sep 17 23:46:49 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:49 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789" returned: 0 in 0.304s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-2eee95fd-016d-4f53-b33d-3ae3867a1789" released by "_copy_volume_from_snapshot" :: held 14.052s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Acquiring lock "cinder-quobyte-ab19a9c9-66d5-4e3d-98c8-024f18972ad2" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-ab19a9c9-66d5-4e3d-98c8-024f18972ad2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Deleting offline snapshot ab19a9c9-66d5-4e3d-98c8-024f18972ad2 of volume b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] snapshot_file for this snap is: volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efbefed-8841-45d5-b271-acebde1657fe]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:49 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150.404fb12f-7a95-4985-a54c-659ea4a857be" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:49 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 Sep 17 23:46:49 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-404fb12f-7a95-4985-a54c-659ea4a857be" released by "_delete_snapshot" :: held 3.221s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" released by "delete_snapshot" :: held 3.275s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:49 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Created reservations ['bb6c3700-e045-48b9-a95a-0972172f024f', '83d830a5-4ce6-459c-8c9f-52e9dc8413f3', 'c946db71-f6f5-4ed7-bc89-4b900edd6969', 'e23c0969-12af-4504-9251-22c329ecb408'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:50 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Delete snapshot completed successfully. Sep 17 23:46:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-56eb2e53-ae6b-4158-b312-2860c84d68fd tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-404fb12f-7a95-4985-a54c-659ea4a857be-delete_snapshot" released by "delete_snapshot" :: held 3.469s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:50 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2" returned: 0 in 0.487s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:46:50 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28e0e51-a291-4c7d-aac6-08933cc8fae7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:50 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 Sep 17 23:46:50 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:50 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" returned: 0 in 0.591s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:50 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 Sep 17 23:46:50 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-321e70d6-64e9-419b-91dd-61b010bd8150-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-321e70d6-64e9-419b-91dd-61b010bd8150-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55b783-0a9a-4ce6-82ba-27a625e27baf]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:51 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2" returned: 0 in 0.555s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:51 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 Sep 17 23:46:51 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:51 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2 Sep 17 23:46:51 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:51 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69.ab19a9c9-66d5-4e3d-98c8-024f18972ad2" returned: 0 in 0.384s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:51 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150" returned: 0 in 0.560s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-ab19a9c9-66d5-4e3d-98c8-024f18972ad2" released by "_delete_snapshot" :: held 2.197s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:51 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150 Sep 17 23:46:51 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.403s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:52 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0d5952c2-8417-4647-a4c8-04c22f58be37 tempest-GroupsV314Test-892268517 None] Create group from source-group-c40b7489-9525-446a-9435-232f74801b39 completed successfully. Sep 17 23:46:52 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-321e70d6-64e9-419b-91dd-61b010bd8150" returned: 0 in 0.441s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-quobyte-321e70d6-64e9-419b-91dd-61b010bd8150" released by "delete_volume" :: held 1.124s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Created reservations ['67030cf6-ba7e-4e7e-bc9e-8386b2c751be', '0e73c7b3-7f25-465d-afc1-475eb48132ed', 'b0aa6f3f-ec60-4b24-a446-e1f39e4432da', '45b162ad-90de-4a50-a59a-ca24689cb3bf'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:52 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:52 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Acquiring lock "cinder-quobyte-2eee95fd-016d-4f53-b33d-3ae3867a1789" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-2eee95fd-016d-4f53-b33d-3ae3867a1789" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c0096-59e1-472d-be65-50d3a30da9be]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:52 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.376s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:52 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:52 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Deleted volume successfully. Sep 17 23:46:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-29716ed2-096f-48af-ab61-c827305f1801 tempest-VolumesSnapshotListTestJSON-1241567231 None] Lock "cinder-321e70d6-64e9-419b-91dd-61b010bd8150-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:53 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 Sep 17 23:46:53 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:53 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789" returned: 0 in 0.503s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:53 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789 Sep 17 23:46:53 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:53 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2eee95fd-016d-4f53-b33d-3ae3867a1789" returned: 0 in 0.371s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-2eee95fd-016d-4f53-b33d-3ae3867a1789" released by "delete_volume" :: held 0.948s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:53 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Created reservations ['f7d88e1a-ad17-4d54-8ef9-07508e050b66'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:53 devstack cinder-volume[85956]: WARNING cinder.quota [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2004884903 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2004884903, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:46:53 devstack cinder-volume[85956]: WARNING cinder.quota [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2004884903 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2004884903, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:46:53 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Created reservations ['63ffa554-b3b9-46d9-9e6d-903d34bfd123', '42191b49-9dd7-4772-a8e2-cadd47bb6ea3', '99393b0d-e143-4c4f-8de9-ea7e47e2361f', 'f85070f2-cbc1-42c6-893d-558bc572eae6'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:54 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:54 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Acquiring lock "cinder-quobyte-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:46:54 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.577s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[65710511-6911-4e77-a09a-3dd330329e60]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:46:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:54 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5bb17ecc-c774-4833-8838-341432fa0e3e tempest-GroupsV314Test-892268517 None] Delete group completed successfully. Sep 17 23:46:54 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 Sep 17 23:46:54 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:55 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" returned: 0 in 0.596s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:55 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69 Sep 17 23:46:55 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:55 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" returned: 0 in 0.359s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Lock "cinder-quobyte-b720bf31-c96b-4ee8-985e-1cc73f1ddc69" released by "delete_volume" :: held 1.062s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:46:55 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=150,cinder:SELECT=133,cinder:INSERT=42,cinder:DELETE=14 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:46:55 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Created reservations ['247b7b1a-90b1-4bef-99df-f1c825e8ce16'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:55 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Created reservations ['b7b29de1-fd70-4a63-b310-0b810adae3c7', 'efcdb4c9-9543-4066-b281-8c1b9535e4ac', '6cf9a5ba-d7c8-4916-beaf-56d0f3145516', '8e8d8f58-cc25-49c4-a9cd-8a3ea6433cf4'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:46:56 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:46:56 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:46:56 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.341s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:46:56 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:46:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-76188cbc-b662-4e50-83d7-026625f66aa5 tempest-GroupsV314Test-892268517 None] Delete group completed successfully. Sep 17 23:47:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Acquiring lock "cinder-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Lock "cinder-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:00 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=186,cinder:DELETE=10,cinder:SELECT=153,cinder:INSERT=52 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:47:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Acquiring lock "cinder-quobyte-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Lock "cinder-quobyte-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be" acquired by "delete_volume" :: waited 0.036s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:01 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8480a5-0fb7-45d5-82f1-ee0389f34f71]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:01 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be Sep 17 23:47:01 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:01 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be" returned: 0 in 0.491s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:01 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be Sep 17 23:47:01 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:01 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be" returned: 0 in 0.383s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Lock "cinder-quobyte-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be" released by "delete_volume" :: held 0.972s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Created reservations ['a1dc7785-3cd7-4179-a299-c0f0cacd36a6', '43ef6566-231b-4361-95c2-97c041c5cd5a', 'd5719d68-d77f-4e9e-8c08-28ec94bcc31b', '474efca6-220c-4fd8-bcb3-b26cd83ce710'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:02 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:47:02 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:02 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.320s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:47:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Deleted volume successfully. Sep 17 23:47:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7e083bea-889a-4ba5-bbb4-fd01d8b0cfdb tempest-VolumesNegativeTest-1451425477 None] Lock "cinder-8a13ab4c-a7ff-4016-ab88-9fe0e2e348be-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Flow 'volume_create_manager' (db4e5ba5-0fb4-4a7c-9c92-ce57f2ffdf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7d2fc0-3f19-4abc-8ffd-f93a3bffa307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7d2fc0-3f19-4abc-8ffd-f93a3bffa307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-113800419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feae30b0-1add-4f99-ba7b-0f10597ecfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483b3e034c4a4c4fa858d0d948478260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:07Z,use_quota=True,user_id='9404fbfee3264cf6826b7307081e68da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf6592e-5296-4bbd-a53c-19a1b78d54a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf6592e-5296-4bbd-a53c-19a1b78d54a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f383f-2674-483c-af02-c0632fa361ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f383f-2674-483c-af02-c0632fa361ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feae30b0-1add-4f99-ba7b-0f10597ecfef', 'volume_name': 'volume-feae30b0-1add-4f99-ba7b-0f10597ecfef', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d9f78b-2df7-4c2c-ad00-5587fba6d124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d9f78b-2df7-4c2c-ad00-5587fba6d124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b3560-8215-4c7f-8d08-e7da7d686bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:07 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Volume feae30b0-1add-4f99-ba7b-0f10597ecfef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feae30b0-1add-4f99-ba7b-0f10597ecfef', 'volume_size': 1} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-113800419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feae30b0-1add-4f99-ba7b-0f10597ecfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483b3e034c4a4c4fa858d0d948478260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:07Z,use_quota=True,user_id='9404fbfee3264cf6826b7307081e68da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Creating volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:47:07 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:47:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:07 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef 1073741824 Sep 17 23:47:07 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:08 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef 1073741824" returned: 0 in 0.622s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:08 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef Sep 17 23:47:08 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:08 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef" returned: 0 in 0.404s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b3560-8215-4c7f-8d08-e7da7d686bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feae30b0-1add-4f99-ba7b-0f10597ecfef', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf737a5e-04d5-4182-923d-e27ae2a30fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:08 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Volume volume-feae30b0-1add-4f99-ba7b-0f10597ecfef (feae30b0-1add-4f99-ba7b-0f10597ecfef): created successfully Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf737a5e-04d5-4182-923d-e27ae2a30fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Flow 'volume_create_manager' (db4e5ba5-0fb4-4a7c-9c92-ce57f2ffdf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:47:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0cd10e59-a358-4226-9c76-e9cdf9d1c814 tempest-SnapshotsActionsTest-1659799795 None] Created volume successfully. Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Flow 'volume_create_manager' (616d08ce-9e93-47c8-813c-70d54d92c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d28e277-0f77-48d3-9ece-cc62d25d4e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d28e277-0f77-48d3-9ece-cc62d25d4e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1379400281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f531d1-fff7-47d4-a646-17cf5eba94dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d990cd1784b1d8f174e7ba824b5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:09Z,use_quota=True,user_id='e163585255e944ecb636999c6347c249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f2cdc4-9396-446d-b139-b5002c866612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f2cdc4-9396-446d-b139-b5002c866612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addce904-6a86-44cc-b386-8f2bdab71e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addce904-6a86-44cc-b386-8f2bdab71e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f531d1-fff7-47d4-a646-17cf5eba94dc', 'volume_name': 'volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc', 'volume_size': 2}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec87338d-75f1-4734-b5ae-1d2e88523371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec87338d-75f1-4734-b5ae-1d2e88523371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cbd102-d628-45c5-b112-6571d56695cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:09 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Volume e8f531d1-fff7-47d4-a646-17cf5eba94dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc', 'volume_size': 2} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1379400281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f531d1-fff7-47d4-a646-17cf5eba94dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d990cd1784b1d8f174e7ba824b5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:09Z,use_quota=True,user_id='e163585255e944ecb636999c6347c249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Creating volume e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:47:09 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc 2147483648 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:09 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc 2147483648 Sep 17 23:47:09 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:09 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc 2147483648" returned: 0 in 0.709s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:09 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc Sep 17 23:47:09 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:10 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc" returned: 0 in 0.272s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.270s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cbd102-d628-45c5-b112-6571d56695cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc', 'volume_size': 2}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b6eff0-58e3-4329-b9e7-be3b358b4a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Creating offline snapshot 1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:47:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Volume volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc (e8f531d1-fff7-47d4-a646-17cf5eba94dc): created successfully Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b6eff0-58e3-4329-b9e7-be3b358b4a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Flow 'volume_create_manager' (616d08ce-9e93-47c8-813c-70d54d92c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f4ac4-6bc8-4e6a-b969-97b392cec5b8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d0204a6f-ce36-4925-80b7-21247e137615 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Created volume successfully. Sep 17 23:47:10 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef Sep 17 23:47:10 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:10 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef" returned: 0 in 0.442s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:10 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 1G Sep 17 23:47:10 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:11 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 1G" returned: 0 in 0.665s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:11 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:11 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:11 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.395s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:11 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 is being set with open permissions: ugo+rw Sep 17 23:47:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:11 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:11 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:12 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:12 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.info Sep 17 23:47:12 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:12 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.info" returned: 0 in 0.285s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:12 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.info is being set with open permissions: ugo+rw Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:12 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.info Sep 17 23:47:12 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:12 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.info" returned: 0 in 0.300s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.465s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Creating offline snapshot cf21b1da-07a3-483b-97c8-7716fc8459ba of volume e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:47:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7b6a299c-cc57-4e24-9920-799cd37d1db5 tempest-SnapshotsActionsTest-1659799795 None] Create snapshot completed successfully Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe92b29-793e-433c-a86c-a1114ceb45b5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:12 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc Sep 17 23:47:12 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:13 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc" returned: 0 in 0.407s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba 2G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:13 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba 2G Sep 17 23:47:13 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:13 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba 2G" returned: 0 in 0.523s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:13 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba Sep 17 23:47:13 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:14 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba" returned: 0 in 0.295s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:14 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba is being set with open permissions: ugo+rw Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:14 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba Sep 17 23:47:14 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:14 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:14 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.info Sep 17 23:47:14 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:14 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.info" returned: 0 in 0.282s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:14 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.info is being set with open permissions: ugo+rw Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:14 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.info Sep 17 23:47:14 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:14 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.info" returned: 0 in 0.257s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.252s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Creating offline snapshot c056e16a-618b-4f42-a5b3-85f5541cb33e of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:47:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-76fb3220-a70b-4cab-a4a9-eb9747c57d46 tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Create snapshot completed successfully Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e52c57e-a3d2-46c7-8e72-b28be6c5bace]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:15 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:15 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:15 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:15 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e 1G Sep 17 23:47:15 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "cinder-cf21b1da-07a3-483b-97c8-7716fc8459ba-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-cf21b1da-07a3-483b-97c8-7716fc8459ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "cinder-quobyte-e8f531d1-fff7-47d4-a646-17cf5eba94dc" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-quobyte-e8f531d1-fff7-47d4-a646-17cf5eba94dc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "cinder-quobyte-cf21b1da-07a3-483b-97c8-7716fc8459ba" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-quobyte-cf21b1da-07a3-483b-97c8-7716fc8459ba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Deleting offline snapshot cf21b1da-07a3-483b-97c8-7716fc8459ba of volume e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] snapshot_file for this snap is: volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214c468-7a50-4fd2-b61e-aec704be114b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:15 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba Sep 17 23:47:15 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:15 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e 1G" returned: 0 in 0.471s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:15 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e Sep 17 23:47:15 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:16 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba" returned: 0 in 0.421s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72e7169-b965-4996-a46f-f6809e27a869]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:16 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc Sep 17 23:47:16 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:16 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e" returned: 0 in 0.345s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:16 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e is being set with open permissions: ugo+rw Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:16 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e Sep 17 23:47:16 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:16 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc" returned: 0 in 0.414s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:16 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e" returned: 0 in 0.265s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:16 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba Sep 17 23:47:16 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.668s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c427a5e1-9e54-407c-837f-e5b4c45e9faf tempest-SnapshotsActionsTest-1659799795 None] Create snapshot completed successfully Sep 17 23:47:16 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba" returned: 0 in 0.363s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:16 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba Sep 17 23:47:16 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-c056e16a-618b-4f42-a5b3-85f5541cb33e-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-c056e16a-618b-4f42-a5b3-85f5541cb33e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-c056e16a-618b-4f42-a5b3-85f5541cb33e" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-c056e16a-618b-4f42-a5b3-85f5541cb33e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Deleting offline snapshot c056e16a-618b-4f42-a5b3-85f5541cb33e of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] snapshot_file for this snap is: volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ba8671-316b-4862-a2db-5a0925978c8d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:17 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc.cf21b1da-07a3-483b-97c8-7716fc8459ba" returned: 0 in 0.298s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:17 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e Sep 17 23:47:17 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-quobyte-cf21b1da-07a3-483b-97c8-7716fc8459ba" released by "_delete_snapshot" :: held 1.622s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-quobyte-e8f531d1-fff7-47d4-a646-17cf5eba94dc" released by "delete_snapshot" :: held 1.657s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Created reservations ['1ccb4db0-223b-4b37-97fd-7a6f171555ba', '18c4f926-4bb0-405d-882c-42bc012c5d9b', 'ca7687c3-1b26-4348-bafa-51a4cd411be5', '7d8e41b3-82da-42d7-9c13-6a1161444a99'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Delete snapshot completed successfully. Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9603d454-8c94-4886-bf59-44c1e2a72f7c tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-cf21b1da-07a3-483b-97c8-7716fc8459ba-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:17 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[af720898-b811-4a27-80a3-f47503d38a16]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:17 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:17 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "cinder-e8f531d1-fff7-47d4-a646-17cf5eba94dc-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-e8f531d1-fff7-47d4-a646-17cf5eba94dc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "cinder-quobyte-e8f531d1-fff7-47d4-a646-17cf5eba94dc" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-quobyte-e8f531d1-fff7-47d4-a646-17cf5eba94dc" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:17 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[acab1453-4d7b-4ac3-b8c4-5c0d787076b4]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.453s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:18 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e Sep 17 23:47:18 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:18 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc Sep 17 23:47:18 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:18 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc" returned: 0 in 0.400s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:18 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc Sep 17 23:47:18 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:18 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e" returned: 0 in 0.464s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:18 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e Sep 17 23:47:18 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:18 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e8f531d1-fff7-47d4-a646-17cf5eba94dc" returned: 0 in 0.265s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-quobyte-e8f531d1-fff7-47d4-a646-17cf5eba94dc" released by "delete_volume" :: held 0.745s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Created reservations ['7b0db1ac-cd0c-44e8-acf7-7ee94d5a3f62', '06ab5637-124f-41f6-8baf-08251f41e11d', 'e0871bff-6f52-41be-9432-e38aea9f6e6e', '53b99a17-1999-4f0c-9e45-7b0960a30e7e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:18 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.c056e16a-618b-4f42-a5b3-85f5541cb33e" returned: 0 in 0.314s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-c056e16a-618b-4f42-a5b3-85f5541cb33e" released by "_delete_snapshot" :: held 1.786s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" released by "delete_snapshot" :: held 1.819s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:19 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:47:19 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Created reservations ['e0f29a2f-f177-4588-934d-555876b3aad3', 'c7391d17-a510-4d4e-984e-6874b6ab17fe', 'd05805c6-9d41-4ddb-9274-690b413dfc09', '05cee3f5-32b2-4a3e-a610-a3478634744c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Delete snapshot completed successfully. Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7f9cd6ef-1ca8-486b-8d92-e356dbdada07 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-c056e16a-618b-4f42-a5b3-85f5541cb33e-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:19 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.491s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:47:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Deleted volume successfully. Sep 17 23:47:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-383e77b5-611f-4b86-b0d3-4b2e9fb8485e tempest-VolumesSnapshotNegativeTestJSON-1825537910 None] Lock "cinder-e8f531d1-fff7-47d4-a646-17cf5eba94dc-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Creating offline snapshot a83c7973-664b-487c-81c9-0e3e0883638c of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:47:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f35ed-1e24-4c2c-b9bf-7c5f06c011e9]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:20 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:20 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:21 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.476s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:21 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c 1G Sep 17 23:47:21 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:22 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c 1G" returned: 0 in 0.850s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:22 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c Sep 17 23:47:22 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:22 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c" returned: 0 in 0.495s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:22 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c is being set with open permissions: ugo+rw Sep 17 23:47:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:22 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c Sep 17 23:47:22 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:22 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d582fe5f-c376-473a-a01b-1aa896fab4d0 tempest-SnapshotsActionsTest-1659799795 None] Create snapshot completed successfully Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-a83c7973-664b-487c-81c9-0e3e0883638c-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-a83c7973-664b-487c-81c9-0e3e0883638c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-a83c7973-664b-487c-81c9-0e3e0883638c" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-a83c7973-664b-487c-81c9-0e3e0883638c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Deleting offline snapshot a83c7973-664b-487c-81c9-0e3e0883638c of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] snapshot_file for this snap is: volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5eff20-f55e-4eb4-8825-155f04e8f501]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:24 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c Sep 17 23:47:24 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:24 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c" returned: 0 in 0.511s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea0cc8-207a-4b87-9194-b6b321def9e2]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:24 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:24 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:25 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.594s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:25 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c Sep 17 23:47:25 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:25 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c" returned: 0 in 0.444s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:25 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c Sep 17 23:47:25 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:26 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.a83c7973-664b-487c-81c9-0e3e0883638c" returned: 0 in 0.274s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-a83c7973-664b-487c-81c9-0e3e0883638c" released by "_delete_snapshot" :: held 1.979s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" released by "delete_snapshot" :: held 2.013s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Created reservations ['36427747-f8ec-4580-8f2e-70cd6d5b1452', '0eb235db-a113-462a-bdd7-be7c9649de69', 'e74ebf02-89e4-4d01-bf9c-b9eadaf05bf7', 'f11d1313-ffc7-44b8-8bee-3b399a8030b6'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Delete snapshot completed successfully. Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cfc9acc1-ba4f-48b8-94a6-cc062d1915ce tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-a83c7973-664b-487c-81c9-0e3e0883638c-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Creating offline snapshot 80760162-49c4-4083-850c-848bbec997e5 of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b2455-f174-4589-8f10-fb925be63696]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:26 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:26 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:27 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.404s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:27 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 1G Sep 17 23:47:27 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:27 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 1G" returned: 0 in 0.614s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:27 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 Sep 17 23:47:27 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:28 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:28 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 is being set with open permissions: ugo+rw Sep 17 23:47:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:28 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 Sep 17 23:47:28 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:28 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5" returned: 0 in 0.409s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0ebf8243-517b-4786-b7fc-2dca35a6b7f7 tempest-SnapshotsActionsTest-1659799795 None] Create snapshot completed successfully Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-80760162-49c4-4083-850c-848bbec997e5-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-80760162-49c4-4083-850c-848bbec997e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-80760162-49c4-4083-850c-848bbec997e5" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-80760162-49c4-4083-850c-848bbec997e5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Deleting offline snapshot 80760162-49c4-4083-850c-848bbec997e5 of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] snapshot_file for this snap is: volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeac4fb7-f8ea-48c4-a52f-9ded1966b52d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:29 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 Sep 17 23:47:29 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:29 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f93d35-db48-4bce-ada0-b6eff130e080]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:29 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:29 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Acquiring lock "cinder-73fcbf53-0827-4381-a02f-608dc9930a7a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "cinder-73fcbf53-0827-4381-a02f-608dc9930a7a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Acquiring lock "cinder-quobyte-73fcbf53-0827-4381-a02f-608dc9930a7a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "cinder-quobyte-73fcbf53-0827-4381-a02f-608dc9930a7a" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece2450b-0534-4af5-a12f-bd5d73825758]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:30 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:30 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 Sep 17 23:47:30 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:30 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a Sep 17 23:47:30 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:30 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a" returned: 0 in 0.606s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:30 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a Sep 17 23:47:30 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:30 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5" returned: 0 in 0.636s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:30 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5 Sep 17 23:47:30 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:30 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-73fcbf53-0827-4381-a02f-608dc9930a7a" returned: 0 in 0.301s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "cinder-quobyte-73fcbf53-0827-4381-a02f-608dc9930a7a" released by "delete_volume" :: held 0.995s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:31 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.80760162-49c4-4083-850c-848bbec997e5" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-80760162-49c4-4083-850c-848bbec997e5" released by "_delete_snapshot" :: held 1.997s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Created reservations ['9b416047-d1f0-47e6-a0b5-d894b9d7c98c', '2d4f84b4-379c-44ba-be2e-7773943eaa48', 'ce788ed6-53e5-4ebf-a268-a0dd681846f3', '54b9380c-e7cd-4dd0-bbf2-3f05f23f3370'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" released by "delete_snapshot" :: held 2.027s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Created reservations ['d0e8e7f8-aa93-4b12-af35-c278215f534b', '48385630-353f-4c28-8333-0d8568f9df58', '3838a169-0100-43f1-ae46-ba5a2b0dfb59', '1e88b2b5-5715-4f50-8fc3-b53bb2d163be'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:31 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:47:31 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Delete snapshot completed successfully. Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e64b5863-e0bb-4fc4-b83a-1a0735adf47d tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-80760162-49c4-4083-850c-848bbec997e5-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:31 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.326s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:47:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Deleted volume successfully. Sep 17 23:47:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e6f6092a-079a-471d-b193-0e2b452bed70 tempest-AttachVolumeShelveTestJSON-1865294574 None] Lock "cinder-73fcbf53-0827-4381-a02f-608dc9930a7a-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Creating offline snapshot 5ad2cca8-acbe-43b3-8b9a-fe607f1f451d of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:47:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64d82de-1aa8-4d2b-ac4e-f6bd25e0604a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:32 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:32 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:33 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.413s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:33 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d 1G Sep 17 23:47:33 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:33 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d 1G" returned: 0 in 0.622s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:33 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d Sep 17 23:47:33 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:34 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" returned: 0 in 0.428s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:34 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d is being set with open permissions: ugo+rw Sep 17 23:47:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:34 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d Sep 17 23:47:34 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:34 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" returned: 0 in 0.305s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:34 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f178234b-6a90-40e0-ba9e-30033cd316e6 tempest-SnapshotsActionsTest-1659799795 None] Create snapshot completed successfully Sep 17 23:47:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-5ad2cca8-acbe-43b3-8b9a-fe607f1f451d-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-5ad2cca8-acbe-43b3-8b9a-fe607f1f451d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Acquiring lock "cinder-quobyte-5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Deleting offline snapshot 5ad2cca8-acbe-43b3-8b9a-fe607f1f451d of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] snapshot_file for this snap is: volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb30f6fe-d07f-4c1e-960a-89dc4478a7f0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:35 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d Sep 17 23:47:35 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:35 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" returned: 0 in 0.621s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[89995c15-8020-4c31-9b9d-1b660aebc2dc]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:35 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:35 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:36 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.553s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:36 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d Sep 17 23:47:36 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:36 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" returned: 0 in 0.558s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:36 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d Sep 17 23:47:36 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:37 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" returned: 0 in 0.364s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-5ad2cca8-acbe-43b3-8b9a-fe607f1f451d" released by "_delete_snapshot" :: held 2.274s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" released by "delete_snapshot" :: held 2.311s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:37 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Created reservations ['a57f2a20-9879-43ed-aef3-0bb26d3228c5', '6cea5b10-2cb5-401f-b326-d83d777abda4', '2c46cead-a45a-426d-a863-2bd85cf5e90c', '682b21f5-a3dd-4adf-a884-920c7c12ac0b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Delete snapshot completed successfully. Sep 17 23:47:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-898d8059-86b8-4f3f-a7f4-ec7017af4f36 tempest-SnapshotsActionsTest-617760942 None] Lock "cinder-5ad2cca8-acbe-43b3-8b9a-fe607f1f451d-delete_snapshot" released by "delete_snapshot" :: held 2.578s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "cinder-1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "cinder-quobyte-1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-quobyte-1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Deleting offline snapshot 1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 of volume feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] snapshot_file for this snap is: volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec07888-32c4-4697-aa7d-0b6a68eba90a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:38 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:39 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:39 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.423s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feae30b0-1add-4f99-ba7b-0f10597ecfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:47:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d814f-a7b1-4fbb-af3c-81db91f2c77b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:39 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef Sep 17 23:47:39 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:39 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef" returned: 0 in 0.443s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:39 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:39 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:40 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.402s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:40 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63 Sep 17 23:47:40 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:40 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef.1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" returned: 0 in 0.356s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-quobyte-1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63" released by "_delete_snapshot" :: held 1.798s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" released by "delete_snapshot" :: held 1.836s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:40 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Created reservations ['7bed70ee-0e17-42fc-b036-7c86bed50543', 'f671d01b-6ca3-4e68-930f-912c2cc784c2', '6ccbc591-0fde-4c9c-8243-b904926ee1fc', '24cb55b2-7e1b-4b01-9bb4-855438b7c600'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Delete snapshot completed successfully. Sep 17 23:47:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d04ec47-e6c4-479c-8d8a-8cb5c4beef2a tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-1f5447f7-d1ae-49ec-a5df-edcdd6ad8c63-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "cinder-feae30b0-1add-4f99-ba7b-0f10597ecfef-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-feae30b0-1add-4f99-ba7b-0f10597ecfef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" acquired by "delete_volume" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f1a6c-4161-4dc0-8c07-cf04c753814f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:41 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef Sep 17 23:47:41 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:41 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef" returned: 0 in 0.494s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:41 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef Sep 17 23:47:41 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:42 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-feae30b0-1add-4f99-ba7b-0f10597ecfef" returned: 0 in 0.288s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-quobyte-feae30b0-1add-4f99-ba7b-0f10597ecfef" released by "delete_volume" :: held 0.882s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Created reservations ['583ea248-431c-4346-a36e-d135faadde54', '2a965abc-fbbe-4aab-8ef5-8f2d3e6ff881', '624a349d-3831-4dfc-89d8-ce42e4c58d4e', '13b53f82-f29a-4961-89e5-1087352c6ca6'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:42 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:47:42 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:42 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:47:42 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.296s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:42 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:47:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Deleted volume successfully. Sep 17 23:47:42 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5bbd3aea-d439-4c4d-a137-ca13e79959c6 tempest-SnapshotsActionsTest-1659799795 None] Lock "cinder-feae30b0-1add-4f99-ba7b-0f10597ecfef-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.425s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:47:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:47:52 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:INSERT=22,cinder:SELECT=73,cinder:UPDATE=90,cinder:DELETE=5 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:47:52 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=69,cinder:INSERT=24,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Flow 'volume_create_manager' (1a3d03e9-8eb5-450f-8b9e-d962a6552427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2a128f-2e9b-4685-bc93-b8e5809e3e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2a128f-2e9b-4685-bc93-b8e5809e3e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1884258378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6704e26d-d0fb-4c44-9e1c-9b279087221a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f391ff53d58243028b9e393403260503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:58Z,use_quota=True,user_id='006b064c581948f7a8b940483dca723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5198f406-ae2c-46f1-bc8b-da8193e0150d),volume_type_id=5198f406-ae2c-46f1-bc8b-da8193e0150d)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786b800c-08f5-44ab-81b1-4f44e96c6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786b800c-08f5-44ab-81b1-4f44e96c6a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21db4511-d002-464c-974c-9fcdce141094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21db4511-d002-464c-974c-9fcdce141094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6704e26d-d0fb-4c44-9e1c-9b279087221a', 'volume_name': 'volume-6704e26d-d0fb-4c44-9e1c-9b279087221a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abe7da7-8f77-4486-9011-12fc5a4a6b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abe7da7-8f77-4486-9011-12fc5a4a6b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b66de7-8f92-4c4d-8010-4838314108ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:58 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume 6704e26d-d0fb-4c44-9e1c-9b279087221a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6704e26d-d0fb-4c44-9e1c-9b279087221a', 'volume_size': 1} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1884258378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6704e26d-d0fb-4c44-9e1c-9b279087221a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f391ff53d58243028b9e393403260503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:58Z,use_quota=True,user_id='006b064c581948f7a8b940483dca723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5198f406-ae2c-46f1-bc8b-da8193e0150d),volume_type_id=5198f406-ae2c-46f1-bc8b-da8193e0150d)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Creating volume 6704e26d-d0fb-4c44-9e1c-9b279087221a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:47:58 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:58 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a 1073741824 Sep 17 23:47:58 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Flow 'volume_create_manager' (6e1f0e61-6261-4bda-9c07-d5e0cdd76eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb94adfc-5409-4eed-aee6-07c85ce8deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb94adfc-5409-4eed-aee6-07c85ce8deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1754624732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d90831-1fc4-4a23-b39d-92599a2fae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f391ff53d58243028b9e393403260503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:59Z,use_quota=True,user_id='006b064c581948f7a8b940483dca723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7fc3b4-8d16-42ce-ab04-f49fb9d925c6),volume_type_id=9d7fc3b4-8d16-42ce-ab04-f49fb9d925c6)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfac4b7-f05b-4b95-9e00-22f78feea154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfac4b7-f05b-4b95-9e00-22f78feea154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d514200-f783-4f11-9609-967e6a13afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d514200-f783-4f11-9609-967e6a13afdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d90831-1fc4-4a23-b39d-92599a2fae33', 'volume_name': 'volume-b6d90831-1fc4-4a23-b39d-92599a2fae33', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f4a0db-4fce-45b1-8689-607b5262aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f4a0db-4fce-45b1-8689-607b5262aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae8cc5b-d642-477c-8607-abb1b44859e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume b6d90831-1fc4-4a23-b39d-92599a2fae33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d90831-1fc4-4a23-b39d-92599a2fae33', 'volume_size': 1} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:47:59 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a 1073741824" returned: 0 in 0.897s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:47:59 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a Sep 17 23:47:59 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Flow 'volume_create_manager' (0340bddb-a297-4e65-b37a-17375c2c7319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cbfe0c-3c68-4936-accc-14a36e8d50d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cbfe0c-3c68-4936-accc-14a36e8d50d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1122353824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3167de3b-78ef-4d64-b041-28e721434d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f391ff53d58243028b9e393403260503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:00Z,use_quota=True,user_id='006b064c581948f7a8b940483dca723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd7d59cc-c79b-452c-a83b-9c52749f7554),volume_type_id=fd7d59cc-c79b-452c-a83b-9c52749f7554)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83606bc3-c5a1-4e89-a064-91d450c0b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83606bc3-c5a1-4e89-a064-91d450c0b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4e3d4a-578d-4800-91dd-c8cb12b6680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:47:59 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:48:00 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a" returned: 0 in 0.567s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1754624732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d90831-1fc4-4a23-b39d-92599a2fae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f391ff53d58243028b9e393403260503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:47:59Z,use_quota=True,user_id='006b064c581948f7a8b940483dca723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d7fc3b4-8d16-42ce-ab04-f49fb9d925c6),volume_type_id=9d7fc3b4-8d16-42ce-ab04-f49fb9d925c6)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Creating volume b6d90831-1fc4-4a23-b39d-92599a2fae33 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:48:00 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b66de7-8f92-4c4d-8010-4838314108ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6704e26d-d0fb-4c44-9e1c-9b279087221a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:00 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 1073741824 Sep 17 23:48:00 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463125eb-e82b-49c8-8006-27e6d9afc0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:00 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume volume-6704e26d-d0fb-4c44-9e1c-9b279087221a (6704e26d-d0fb-4c44-9e1c-9b279087221a): created successfully Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463125eb-e82b-49c8-8006-27e6d9afc0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Flow 'volume_create_manager' (1a3d03e9-8eb5-450f-8b9e-d962a6552427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e4e345e8-6193-460b-8b03-df38cd1b5292 tempest-TestInstancesWithCinderVolumes-2003590849 None] Created volume successfully. Sep 17 23:48:01 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 1073741824" returned: 0 in 0.867s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4e3d4a-578d-4800-91dd-c8cb12b6680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3167de3b-78ef-4d64-b041-28e721434d15', 'volume_name': 'volume-3167de3b-78ef-4d64-b041-28e721434d15', 'volume_size': 1, 'image_id': '9dee697b-22f2-48ff-8348-c5bff9594582', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dee697b-22f2-48ff-8348-c5bff9594582', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--228034264', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f391ff53d58243028b9e393403260503', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dee697b-22f2-48ff-8348-c5bff9594582', 'created_at': datetime.datetime(2026, 9, 17, 21, 47, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 47, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dee697b-22f2-48ff-8348-c5bff9594582/file', 'properties': {}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1edddcc-4e63-48c3-b24e-57d3219ba5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1edddcc-4e63-48c3-b24e-57d3219ba5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc4e086-520d-4f17-946f-a9104d5ce51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume 3167de3b-78ef-4d64-b041-28e721434d15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3167de3b-78ef-4d64-b041-28e721434d15', 'volume_size': 1, 'image_id': '9dee697b-22f2-48ff-8348-c5bff9594582', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dee697b-22f2-48ff-8348-c5bff9594582', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--228034264', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f391ff53d58243028b9e393403260503', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dee697b-22f2-48ff-8348-c5bff9594582', 'created_at': datetime.datetime(2026, 9, 17, 21, 47, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 47, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dee697b-22f2-48ff-8348-c5bff9594582/file', 'properties': {}}, 'image_service': } Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Trying to clone 3167de3b-78ef-4d64-b041-28e721434d15 from image 9dee697b-22f2-48ff-8348-c5bff9594582 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dee697b-22f2-48ff-8348-c5bff9594582', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:01 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 Sep 17 23:48:01 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:01 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33" returned: 0 in 0.462s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae8cc5b-d642-477c-8607-abb1b44859e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d90831-1fc4-4a23-b39d-92599a2fae33', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949ceaad-e639-4834-90f6-a326cfdba03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 (b6d90831-1fc4-4a23-b39d-92599a2fae33): created successfully Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949ceaad-e639-4834-90f6-a326cfdba03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Flow 'volume_create_manager' (6e1f0e61-6261-4bda-9c07-d5e0cdd76eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-73ee7461-b1b3-4e9a-8cb8-eef255b77fbf tempest-TestInstancesWithCinderVolumes-2003590849 None] Created volume successfully. Sep 17 23:48:05 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD, size 20.69 MB, duration 4.68 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:48:05 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Image download 20.69 MB at 4.42 MB/s Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ea9e0-415c-43ee-9da4-382902257bdf]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:06 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD Sep 17 23:48:06 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:06 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Temporary image 9dee697b-22f2-48ff-8348-c5bff9594582 is fetched for user 006b064c581948f7a8b940483dca723b. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba4711-d2db-45e2-9977-8ecaf58b0472]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:06 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD Sep 17 23:48:06 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:06 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1122353824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3167de3b-78ef-4d64-b041-28e721434d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f391ff53d58243028b9e393403260503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:00Z,use_quota=True,user_id='006b064c581948f7a8b940483dca723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd7d59cc-c79b-452c-a83b-9c52749f7554),volume_type_id=fd7d59cc-c79b-452c-a83b-9c52749f7554)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Creating volume 3167de3b-78ef-4d64-b041-28e721434d15 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:48:06 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:48:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:06 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 1073741824 Sep 17 23:48:06 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:07 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 1073741824" returned: 0 in 0.493s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:07 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 Sep 17 23:48:07 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:07 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15" returned: 0 in 0.290s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Attempting download of 9dee697b-22f2-48ff-8348-c5bff9594582 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dee697b-22f2-48ff-8348-c5bff9594582', 'metadata': {}}])) to volume 3167de3b-78ef-4d64-b041-28e721434d15. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[47705396-773d-4b95-8ffb-6acf173d3c46]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:48:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dee697b-22f2-48ff-8348-c5bff9594582_7gk_i_vx {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:07 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dee697b-22f2-48ff-8348-c5bff9594582_7gk_i_vx Sep 17 23:48:07 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:08 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dee697b-22f2-48ff-8348-c5bff9594582_7gk_i_vx" returned: 0 in 0.373s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dee697b-22f2-48ff-8348-c5bff9594582_7gk_i_vx {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:08 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dee697b-22f2-48ff-8348-c5bff9594582_7gk_i_vx Sep 17 23:48:08 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:08 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dee697b-22f2-48ff-8348-c5bff9594582_7gk_i_vx" returned: 1 in 0.370s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dee697b-22f2-48ff-8348-c5bff9594582_7gk_i_vx' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:48:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d07fb-ae3d-4847-916d-828dc708f263]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:48:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:08 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD Sep 17 23:48:08 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:09 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:09 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] 9dee697b-22f2-48ff-8348-c5bff9594582 was qcow2, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:48:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:09 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 Sep 17 23:48:09 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:11 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15" returned: 0 in 2.856s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:11 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dee697b-22f2-48ff-8348-c5bff9594582_dwtl6knsdevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:48:11 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Converted 112.00 MB image at 39.20 MB/s Sep 17 23:48:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:11 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 1G Sep 17 23:48:11 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:12 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 1G" returned: 0 in 0.568s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Downloaded image 9dee697b-22f2-48ff-8348-c5bff9594582 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dee697b-22f2-48ff-8348-c5bff9594582', 'metadata': {}}])) to volume 3167de3b-78ef-4d64-b041-28e721434d15 successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Temporary image 9dee697b-22f2-48ff-8348-c5bff9594582 for user 006b064c581948f7a8b940483dca723b is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Marking volume 3167de3b-78ef-4d64-b041-28e721434d15 as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Copying metadata from image 9dee697b-22f2-48ff-8348-c5bff9594582 to 3167de3b-78ef-4d64-b041-28e721434d15. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Creating volume glance metadata for volume 3167de3b-78ef-4d64-b041-28e721434d15 backed by image 9dee697b-22f2-48ff-8348-c5bff9594582 with: {'image_id': '9dee697b-22f2-48ff-8348-c5bff9594582', 'image_name': 'tempest-scenario-img--228034264', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc4e086-520d-4f17-946f-a9104d5ce51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3167de3b-78ef-4d64-b041-28e721434d15', 'volume_size': 1, 'image_id': '9dee697b-22f2-48ff-8348-c5bff9594582', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dee697b-22f2-48ff-8348-c5bff9594582', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--228034264', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f391ff53d58243028b9e393403260503', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dee697b-22f2-48ff-8348-c5bff9594582', 'created_at': datetime.datetime(2026, 9, 17, 21, 47, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 47, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dee697b-22f2-48ff-8348-c5bff9594582/file', 'properties': {}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb809502-849b-4374-9cdd-cea7cfa983a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:12 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Volume volume-3167de3b-78ef-4d64-b041-28e721434d15 (3167de3b-78ef-4d64-b041-28e721434d15): created successfully Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb809502-849b-4374-9cdd-cea7cfa983a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Flow 'volume_create_manager' (0340bddb-a297-4e65-b37a-17375c2c7319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-00424832-73fc-4cc2-9dd6-4a3e3eb47da2 tempest-TestInstancesWithCinderVolumes-2003590849 None] Created volume successfully. Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Flow 'volume_create_manager' (e4ecb701-22f0-400e-901e-01d5df81f2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4b54ea-4f5e-4da7-a164-92aa7723cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4b54ea-4f5e-4da7-a164-92aa7723cc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-720369120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b413ab-0127-4b14-868e-e070d8012c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e604570fc44f7ab6e74d976ab2d67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:17Z,use_quota=True,user_id='e1ca0a2529c64b6bb1a47304d3af999c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7f946a-d110-4e4b-88b2-247ceec10bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7f946a-d110-4e4b-88b2-247ceec10bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaba47eb-afab-47be-aa84-6972179c6117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaba47eb-afab-47be-aa84-6972179c6117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b413ab-0127-4b14-868e-e070d8012c8b', 'volume_name': 'volume-38b413ab-0127-4b14-868e-e070d8012c8b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f843b8-8283-4801-a706-758a35a03e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f843b8-8283-4801-a706-758a35a03e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4cb27b-daa6-42cf-8e62-0c827e07a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:17 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Volume 38b413ab-0127-4b14-868e-e070d8012c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b413ab-0127-4b14-868e-e070d8012c8b', 'volume_size': 1} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-720369120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b413ab-0127-4b14-868e-e070d8012c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e604570fc44f7ab6e74d976ab2d67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:17Z,use_quota=True,user_id='e1ca0a2529c64b6bb1a47304d3af999c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Creating volume 38b413ab-0127-4b14-868e-e070d8012c8b {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:48:17 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:48:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:17 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b 1073741824 Sep 17 23:48:17 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-05cd732f-647b-4a2b-9b46-9397dddedb99 req-061dba7c-ff66-49a5-99d3-4bfb17eefa97 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:18 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b 1073741824" returned: 0 in 1.192s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:18 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b Sep 17 23:48:18 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:19 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b" returned: 0 in 0.471s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-05cd732f-647b-4a2b-9b46-9397dddedb99 req-061dba7c-ff66-49a5-99d3-4bfb17eefa97 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.940s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4cb27b-daa6-42cf-8e62-0c827e07a653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b413ab-0127-4b14-868e-e070d8012c8b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650c1d07-373b-4afa-8bc0-c674b078a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-05cd732f-647b-4a2b-9b46-9397dddedb99 req-061dba7c-ff66-49a5-99d3-4bfb17eefa97 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:19 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Volume volume-38b413ab-0127-4b14-868e-e070d8012c8b (38b413ab-0127-4b14-868e-e070d8012c8b): created successfully Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650c1d07-373b-4afa-8bc0-c674b078a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Flow 'volume_create_manager' (e4ecb701-22f0-400e-901e-01d5df81f2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9c59193f-f71f-4aee-a84e-b953cf947942 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Created volume successfully. Sep 17 23:48:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-05cd732f-647b-4a2b-9b46-9397dddedb99 req-061dba7c-ff66-49a5-99d3-4bfb17eefa97 tempest-TestInstancesWithCinderVolumes-2003590849 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-3167de3b-78ef-4d64-b041-28e721434d15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '153d01be-ee45-4565-9f6b-854c06f4bcb9', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:48:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-05cd732f-647b-4a2b-9b46-9397dddedb99 req-061dba7c-ff66-49a5-99d3-4bfb17eefa97 tempest-TestInstancesWithCinderVolumes-2003590849 None] attachment_update completed successfully. Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Flow 'volume_create_manager' (3ad20553-6a3c-42f0-8b8b-436b61ba0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46100f4-afa2-45dc-bcf6-f979fadf0c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46100f4-afa2-45dc-bcf6-f979fadf0c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1224435383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f269e992-0bf8-44c5-beca-5561650488d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb9ddfd829c412da7866b2af401aacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:21Z,use_quota=True,user_id='d704762dec5d4259a53dea829144fc3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5847f72-e59a-4f06-a28c-3e45dce7da39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5847f72-e59a-4f06-a28c-3e45dce7da39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50acb99-40c8-426c-9c28-d54a51ba5af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50acb99-40c8-426c-9c28-d54a51ba5af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f269e992-0bf8-44c5-beca-5561650488d4', 'volume_name': 'volume-f269e992-0bf8-44c5-beca-5561650488d4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fae57a3-61d0-407f-833b-eeb9e4fcadc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fae57a3-61d0-407f-833b-eeb9e4fcadc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d0b26d-0b14-4301-850b-ddf9946c2141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:21 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Volume f269e992-0bf8-44c5-beca-5561650488d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f269e992-0bf8-44c5-beca-5561650488d4', 'volume_size': 1} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1224435383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f269e992-0bf8-44c5-beca-5561650488d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb9ddfd829c412da7866b2af401aacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:21Z,use_quota=True,user_id='d704762dec5d4259a53dea829144fc3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Creating volume f269e992-0bf8-44c5-beca-5561650488d4 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:48:21 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:48:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:21 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 1073741824 Sep 17 23:48:21 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-47320a08-505a-48a5-b7c4-82e41c10fa15 req-dade974d-ee1e-4383-b48a-100a74bc6c85 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:22 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 1073741824" returned: 0 in 0.648s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:22 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 Sep 17 23:48:22 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:22 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4" returned: 0 in 0.300s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-47320a08-505a-48a5-b7c4-82e41c10fa15 req-dade974d-ee1e-4383-b48a-100a74bc6c85 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.610s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-47320a08-505a-48a5-b7c4-82e41c10fa15 req-dade974d-ee1e-4383-b48a-100a74bc6c85 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d0b26d-0b14-4301-850b-ddf9946c2141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f269e992-0bf8-44c5-beca-5561650488d4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f727846-02b5-4bcc-9a42-c5a1aaa1c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Volume volume-f269e992-0bf8-44c5-beca-5561650488d4 (f269e992-0bf8-44c5-beca-5561650488d4): created successfully Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f727846-02b5-4bcc-9a42-c5a1aaa1c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Flow 'volume_create_manager' (3ad20553-6a3c-42f0-8b8b-436b61ba0171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a67f943a-52b3-4daf-854b-e6d19dc72245 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Created volume successfully. Sep 17 23:48:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-47320a08-505a-48a5-b7c4-82e41c10fa15 req-dade974d-ee1e-4383-b48a-100a74bc6c85 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-38b413ab-0127-4b14-868e-e070d8012c8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68c9a3e1-d48c-4840-93a6-428acd6dabde', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:48:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-47320a08-505a-48a5-b7c4-82e41c10fa15 req-dade974d-ee1e-4383-b48a-100a74bc6c85 tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] attachment_update completed successfully. Sep 17 23:48:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Acquiring lock "cinder-f269e992-0bf8-44c5-beca-5561650488d4-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:48:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "cinder-f269e992-0bf8-44c5-beca-5561650488d4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:48:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Acquiring lock "cinder-quobyte-f269e992-0bf8-44c5-beca-5561650488d4" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:48:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "cinder-quobyte-f269e992-0bf8-44c5-beca-5561650488d4" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:48:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6bf925-db61-4eed-a6be-b215c844629b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:48:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:26 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 Sep 17 23:48:26 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:26 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4" returned: 0 in 0.706s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:26 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4 Sep 17 23:48:26 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:27 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f269e992-0bf8-44c5-beca-5561650488d4" returned: 0 in 0.514s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "cinder-quobyte-f269e992-0bf8-44c5-beca-5561650488d4" released by "delete_volume" :: held 1.369s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Created reservations ['11c220e8-5979-48dc-b25b-75e45c44a99a', '7040cee0-131d-49e3-9964-6f56480a0b4c', 'fcdd68fc-e2cb-40ca-be01-58753c37a19d', 'c9bf12eb-cc0c-42d3-b52a-f52bbc79a80c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:27 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:48:27 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:28 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.425s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:28 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:48:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Deleted volume successfully. Sep 17 23:48:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-94e1609a-5f9b-41fb-aafb-9d66c3fc9be6 req-133b663f-e0e8-49fe-a973-2e0ede7169bf tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Terminate volume connection completed successfully. Sep 17 23:48:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-94e1609a-5f9b-41fb-aafb-9d66c3fc9be6 req-133b663f-e0e8-49fe-a973-2e0ede7169bf tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Deleting attachment 68c9a3e1-d48c-4840-93a6-428acd6dabde. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:48:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c0da3298-5bef-4112-ab9a-bcd52fbfefd2 tempest-VolumeQuotasNegativeTestJSON-1002020021 None] Lock "cinder-f269e992-0bf8-44c5-beca-5561650488d4-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Acquiring lock "cinder-38b413ab-0127-4b14-868e-e070d8012c8b-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "cinder-38b413ab-0127-4b14-868e-e070d8012c8b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Acquiring lock "cinder-quobyte-38b413ab-0127-4b14-868e-e070d8012c8b" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "cinder-quobyte-38b413ab-0127-4b14-868e-e070d8012c8b" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6e6c9e-5001-4aa9-aa10-20d94300d5fc]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:29 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b Sep 17 23:48:29 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:29 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b" returned: 0 in 0.598s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:29 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b Sep 17 23:48:29 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:30 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-38b413ab-0127-4b14-868e-e070d8012c8b" returned: 0 in 0.406s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "cinder-quobyte-38b413ab-0127-4b14-868e-e070d8012c8b" released by "delete_volume" :: held 1.068s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Created reservations ['018c2bfd-77fe-4164-bf31-6d2290dbbab9', 'aed5ab07-96a6-49b0-bd8c-34d2d88300cd', '40aef627-ea5f-4eef-974a-c0a58ebbcce8', '314687ac-25b0-4f7e-aa11-87ef31783af0'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:30 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:48:30 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:30 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.411s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:48:30 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Deleted volume successfully. Sep 17 23:48:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-363e78a0-970f-41bc-b900-61fee85ef75e tempest-TestServerVolumeAttachScenarioOldVersion-905316584 None] Lock "cinder-38b413ab-0127-4b14-868e-e070d8012c8b-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:48:39 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:48:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Flow 'volume_create_manager' (dccaf585-dde3-4d38-810e-809be9f52e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bf50b5-de81-4e06-9f78-217d2a1f6b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bf50b5-de81-4e06-9f78-217d2a1f6b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-759910148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d892cba8ac864497a941b8edaa9e674c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:40Z,use_quota=True,user_id='4a8c6a53c3af414b8d60a9ee16327fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f090d43-e2ff-4e48-9ebf-b0167ddfe5ec),volume_type_id=8f090d43-e2ff-4e48-9ebf-b0167ddfe5ec)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31edd361-cdfa-44a7-8e36-dd2d71078250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31edd361-cdfa-44a7-8e36-dd2d71078250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aa591a-02f7-4e5b-ae81-ecd9de3cd155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aa591a-02f7-4e5b-ae81-ecd9de3cd155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6', 'volume_name': 'volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a0ac00-c8e5-4731-8731-ed051ad166a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a0ac00-c8e5-4731-8731-ed051ad166a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab89a3a-a4bb-406a-97f5-1465501f0906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Volume adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6', 'volume_size': 1} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-759910148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d892cba8ac864497a941b8edaa9e674c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:40Z,use_quota=True,user_id='4a8c6a53c3af414b8d60a9ee16327fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f090d43-e2ff-4e48-9ebf-b0167ddfe5ec),volume_type_id=8f090d43-e2ff-4e48-9ebf-b0167ddfe5ec)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Creating volume adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:48:40 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:40 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 1073741824 Sep 17 23:48:40 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:40 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 1073741824" returned: 0 in 0.541s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:40 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 Sep 17 23:48:40 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:40 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:40 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Flow 'volume_create_manager' (65901981-4987-49ab-a826-444a9bface07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de82d21e-d2d9-4014-86e8-81c1945a59e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab89a3a-a4bb-406a-97f5-1465501f0906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f0ac8f-85a4-44c7-a6bd-e9ba1a6c9a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Volume volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 (adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6): created successfully Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f0ac8f-85a4-44c7-a6bd-e9ba1a6c9a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Flow 'volume_create_manager' (dccaf585-dde3-4d38-810e-809be9f52e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de82d21e-d2d9-4014-86e8-81c1945a59e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314776542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8254207d-a453-4972-a423-fec478e60271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a9c90bfed640e9bc27e845cd865f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:41Z,use_quota=True,user_id='0697e5934bfa47baada2642f6a198499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950f294d-f693-432d-8523-624d58ca1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950f294d-f693-432d-8523-624d58ca1642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b3d3db-2f92-42fc-99ce-90d6284a3460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b3d3db-2f92-42fc-99ce-90d6284a3460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8254207d-a453-4972-a423-fec478e60271', 'volume_name': 'volume-8254207d-a453-4972-a423-fec478e60271', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980a8306-e8de-4711-b6de-16c56e354d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980a8306-e8de-4711-b6de-16c56e354d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fc340e-3781-4390-893b-f10a445cd5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Volume 8254207d-a453-4972-a423-fec478e60271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8254207d-a453-4972-a423-fec478e60271', 'volume_size': 1} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314776542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8254207d-a453-4972-a423-fec478e60271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a9c90bfed640e9bc27e845cd865f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:48:41Z,use_quota=True,user_id='0697e5934bfa47baada2642f6a198499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Creating volume 8254207d-a453-4972-a423-fec478e60271 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:48:41 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-75f1e004-36cd-4bdd-988d-de7f7596fa1f tempest-VolumeTypesAccessTest-942667293 None] Created volume successfully. Sep 17 23:48:41 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 1073741824 Sep 17 23:48:41 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:41 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 1073741824" returned: 0 in 0.563s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:41 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 Sep 17 23:48:41 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:42 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fc340e-3781-4390-893b-f10a445cd5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8254207d-a453-4972-a423-fec478e60271', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b6f78d-eb66-4187-978c-77a8caf82fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Acquiring lock "cinder-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:48:42 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Volume volume-8254207d-a453-4972-a423-fec478e60271 (8254207d-a453-4972-a423-fec478e60271): created successfully Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b6f78d-eb66-4187-978c-77a8caf82fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Flow 'volume_create_manager' (65901981-4987-49ab-a826-444a9bface07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:48:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-83f1f52b-d7f1-4209-9b97-5c95a09e2d65 tempest-AttachVolumeTestJSON-201289366 None] Created volume successfully. Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Lock "cinder-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:42 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:48:42 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Acquiring lock "cinder-quobyte-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Lock "cinder-quobyte-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a144906-226f-4fc1-98b8-6a1d9af8f21a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:42 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 Sep 17 23:48:42 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:42 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.411s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:48:42 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:42 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6 Sep 17 23:48:42 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:43 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6" returned: 0 in 0.340s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Lock "cinder-quobyte-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6" released by "delete_volume" :: held 0.892s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:48:43 devstack cinder-volume[85956]: WARNING cinder.quota [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-144813889 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-144813889, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:48:43 devstack cinder-volume[85956]: WARNING cinder.quota [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-144813889 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-144813889, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Created reservations ['38c3a3f4-5ec2-49d1-bb22-d367b0e5545d', '24fde598-f4ca-4502-8e57-d67a1d082764', '59629fa9-a0d3-407e-bcb9-6111eecad70d', 'ffb884c6-9412-4cbe-a03e-28bc79ffb60f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:48:43 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:48:43 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:48:43 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.437s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:48:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Deleted volume successfully. Sep 17 23:48:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db7571f5-68f5-4a10-9246-955451210b44 tempest-VolumeTypesAccessTest-942667293 None] Lock "cinder-adee82ee-98b0-4d7e-ad7c-6ab12c69e4d6-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:48:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-ebc3c398-1452-4106-a293-c4dd6b2dbbc1 req-2be02963-5d10-4b49-97a1-e73eb1d4d4dc tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-ebc3c398-1452-4106-a293-c4dd6b2dbbc1 req-2be02963-5d10-4b49-97a1-e73eb1d4d4dc tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-ebc3c398-1452-4106-a293-c4dd6b2dbbc1 req-2be02963-5d10-4b49-97a1-e73eb1d4d4dc tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-ebc3c398-1452-4106-a293-c4dd6b2dbbc1 req-2be02963-5d10-4b49-97a1-e73eb1d4d4dc tempest-AttachVolumeTestJSON-201289366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-8254207d-a453-4972-a423-fec478e60271', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd81caaf7-cfd8-47af-ba6a-e6b2800c6ab8', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:48:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-ebc3c398-1452-4106-a293-c4dd6b2dbbc1 req-2be02963-5d10-4b49-97a1-e73eb1d4d4dc tempest-AttachVolumeTestJSON-201289366 None] attachment_update completed successfully. Sep 17 23:48:54 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=60,cinder:UPDATE=50,cinder:DELETE=6,cinder:INSERT=17 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:48:54 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=53,cinder:SELECT=51,cinder:INSERT=11,cinder:DELETE=4 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:48:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-8544fac9-c1e1-4cde-ba24-4ce443ad59dd req-2a54c089-44ba-4f9f-a411-cfb5bd71a5b4 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:48:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-8544fac9-c1e1-4cde-ba24-4ce443ad59dd req-2a54c089-44ba-4f9f-a411-cfb5bd71a5b4 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:48:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-8544fac9-c1e1-4cde-ba24-4ce443ad59dd req-2a54c089-44ba-4f9f-a411-cfb5bd71a5b4 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:48:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-8544fac9-c1e1-4cde-ba24-4ce443ad59dd req-2a54c089-44ba-4f9f-a411-cfb5bd71a5b4 tempest-TestInstancesWithCinderVolumes-2003590849 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-6704e26d-d0fb-4c44-9e1c-9b279087221a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c66d19f2-86cf-4911-a3e6-5b07089e3a7d', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:48:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-8544fac9-c1e1-4cde-ba24-4ce443ad59dd req-2a54c089-44ba-4f9f-a411-cfb5bd71a5b4 tempest-TestInstancesWithCinderVolumes-2003590849 None] attachment_update completed successfully. Sep 17 23:49:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9d4432fb-4b55-4194-9937-0930d62d76a1 req-844b3e85-2238-4298-b1da-f0d98d9a583f tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9d4432fb-4b55-4194-9937-0930d62d76a1 req-844b3e85-2238-4298-b1da-f0d98d9a583f tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-9d4432fb-4b55-4194-9937-0930d62d76a1 req-844b3e85-2238-4298-b1da-f0d98d9a583f tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9d4432fb-4b55-4194-9937-0930d62d76a1 req-844b3e85-2238-4298-b1da-f0d98d9a583f tempest-TestInstancesWithCinderVolumes-2003590849 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-b6d90831-1fc4-4a23-b39d-92599a2fae33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a52cd91d-02b3-443a-a27d-895bc5b73000', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:49:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-9d4432fb-4b55-4194-9937-0930d62d76a1 req-844b3e85-2238-4298-b1da-f0d98d9a583f tempest-TestInstancesWithCinderVolumes-2003590849 None] attachment_update completed successfully. Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Flow 'volume_create_manager' (e127d0ea-177e-42bb-8d89-8bc19b8e7b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad303c60-0f11-4848-b50e-0e9c539a47fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad303c60-0f11-4848-b50e-0e9c539a47fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1909529610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6163d5a-3f48-445f-bb1a-c6428086ac0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ac9b375d3342f0a0f7acc2042a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:05Z,use_quota=True,user_id='67880846281840faafec65bc08290960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c0e4fb-a4d2-4835-a7fd-5f855d7a3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c0e4fb-a4d2-4835-a7fd-5f855d7a3abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a54e38-fd34-4e5f-94de-46b07d880727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a54e38-fd34-4e5f-94de-46b07d880727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6163d5a-3f48-445f-bb1a-c6428086ac0c', 'volume_name': 'volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d327e095-8053-4d93-b35a-7b1f9df7eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d327e095-8053-4d93-b35a-7b1f9df7eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856d200c-8e7b-4833-9b44-67ab7c13048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:04 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Volume f6163d5a-3f48-445f-bb1a-c6428086ac0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c', 'volume_size': 1} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1909529610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6163d5a-3f48-445f-bb1a-c6428086ac0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ac9b375d3342f0a0f7acc2042a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:05Z,use_quota=True,user_id='67880846281840faafec65bc08290960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Creating volume f6163d5a-3f48-445f-bb1a-c6428086ac0c {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:49:04 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:49:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:04 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c 1073741824 Sep 17 23:49:04 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:05 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c 1073741824" returned: 0 in 0.565s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:05 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c Sep 17 23:49:05 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:05 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c" returned: 0 in 0.360s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856d200c-8e7b-4833-9b44-67ab7c13048c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb71633f-6bc3-4999-aa72-55ec4e009af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:05 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Volume volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c (f6163d5a-3f48-445f-bb1a-c6428086ac0c): created successfully Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb71633f-6bc3-4999-aa72-55ec4e009af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Flow 'volume_create_manager' (e127d0ea-177e-42bb-8d89-8bc19b8e7b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0b7a77d4-2364-4e8a-b0c2-a902929c5e5f tempest-VolumesListAdminTestJSON-652402705 None] Created volume successfully. Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Flow 'volume_create_manager' (d81bc980-bfd7-4a01-8ce3-25cfbda31294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8de9c4-bcb6-4d9a-a232-6692917e09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8de9c4-bcb6-4d9a-a232-6692917e09e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1473075692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be862770-0335-447b-9dc4-12a7efb4645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ac9b375d3342f0a0f7acc2042a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:07Z,use_quota=True,user_id='67880846281840faafec65bc08290960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3bb96a-7a1e-4268-be2e-c944f2c02840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3bb96a-7a1e-4268-be2e-c944f2c02840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55d9348-5186-43e2-8c13-d1eedb7c65d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55d9348-5186-43e2-8c13-d1eedb7c65d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be862770-0335-447b-9dc4-12a7efb4645e', 'volume_name': 'volume-be862770-0335-447b-9dc4-12a7efb4645e', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5aad37-9853-4d5e-afb7-710c067dcca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5aad37-9853-4d5e-afb7-710c067dcca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5658e2-d3e6-4617-8426-bcb9312a402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:07 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Volume be862770-0335-447b-9dc4-12a7efb4645e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be862770-0335-447b-9dc4-12a7efb4645e', 'volume_size': 1} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1473075692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be862770-0335-447b-9dc4-12a7efb4645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ac9b375d3342f0a0f7acc2042a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:07Z,use_quota=True,user_id='67880846281840faafec65bc08290960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Creating volume be862770-0335-447b-9dc4-12a7efb4645e {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:49:07 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:49:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:07 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e 1073741824 Sep 17 23:49:07 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:08 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e 1073741824" returned: 0 in 0.589s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:08 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e Sep 17 23:49:08 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:08 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e" returned: 0 in 0.343s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5658e2-d3e6-4617-8426-bcb9312a402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be862770-0335-447b-9dc4-12a7efb4645e', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bd4063-1582-45cb-8adf-36259926d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:08 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Volume volume-be862770-0335-447b-9dc4-12a7efb4645e (be862770-0335-447b-9dc4-12a7efb4645e): created successfully Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bd4063-1582-45cb-8adf-36259926d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:08 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Flow 'volume_create_manager' (d81bc980-bfd7-4a01-8ce3-25cfbda31294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f62ff6e9-5d64-452f-8cbc-e8913bb5e0b8 tempest-VolumesListAdminTestJSON-652402705 None] Created volume successfully. Sep 17 23:49:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-f7e83875-819b-4aa0-93e5-16f0f36e86e7 req-8a2d3f58-fba2-42da-abca-d02ccd47fbaa tempest-TestInstancesWithCinderVolumes-2003590849 None] Terminate volume connection completed successfully. Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-f7e83875-819b-4aa0-93e5-16f0f36e86e7 req-8a2d3f58-fba2-42da-abca-d02ccd47fbaa tempest-TestInstancesWithCinderVolumes-2003590849 None] Deleting attachment c66d19f2-86cf-4911-a3e6-5b07089e3a7d. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Flow 'volume_create_manager' (03df293c-50ad-4e27-a737-60697c6b69db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0996cdec-e6d2-4222-8d1a-9786c32ba53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0996cdec-e6d2-4222-8d1a-9786c32ba53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-676715659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131442ea-f49b-4ab4-9df2-6377aeafa40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ac9b375d3342f0a0f7acc2042a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:10Z,use_quota=True,user_id='67880846281840faafec65bc08290960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674e19bd-403b-455b-8f77-e27df9ccf4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674e19bd-403b-455b-8f77-e27df9ccf4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a77f81b-95f0-4162-8ef1-727a79bf6a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a77f81b-95f0-4162-8ef1-727a79bf6a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131442ea-f49b-4ab4-9df2-6377aeafa40d', 'volume_name': 'volume-131442ea-f49b-4ab4-9df2-6377aeafa40d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c268a877-7da6-41e0-a982-3b197031c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c268a877-7da6-41e0-a982-3b197031c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a1663e-352a-4037-9bbc-a58a18a40591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Volume 131442ea-f49b-4ab4-9df2-6377aeafa40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131442ea-f49b-4ab4-9df2-6377aeafa40d', 'volume_size': 1} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-676715659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131442ea-f49b-4ab4-9df2-6377aeafa40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ac9b375d3342f0a0f7acc2042a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:10Z,use_quota=True,user_id='67880846281840faafec65bc08290960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Creating volume 131442ea-f49b-4ab4-9df2-6377aeafa40d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:49:10 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:10 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d 1073741824 Sep 17 23:49:10 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:10 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d 1073741824" returned: 0 in 0.434s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:10 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d Sep 17 23:49:10 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "cinder-6704e26d-d0fb-4c44-9e1c-9b279087221a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-6704e26d-d0fb-4c44-9e1c-9b279087221a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "cinder-quobyte-6704e26d-d0fb-4c44-9e1c-9b279087221a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-quobyte-6704e26d-d0fb-4c44-9e1c-9b279087221a" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[82439a62-166e-4add-b473-986057646b0c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:10 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d" returned: 0 in 0.327s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:49:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a1663e-352a-4037-9bbc-a58a18a40591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131442ea-f49b-4ab4-9df2-6377aeafa40d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:11 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a Sep 17 23:49:11 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20751a44-e527-44e1-9362-7d16c09f4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Volume volume-131442ea-f49b-4ab4-9df2-6377aeafa40d (131442ea-f49b-4ab4-9df2-6377aeafa40d): created successfully Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20751a44-e527-44e1-9362-7d16c09f4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Flow 'volume_create_manager' (03df293c-50ad-4e27-a737-60697c6b69db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-363c3310-991e-4442-88be-1b11a6eed83a tempest-VolumesListAdminTestJSON-652402705 None] Created volume successfully. Sep 17 23:49:11 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a" returned: 0 in 0.439s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:11 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a Sep 17 23:49:11 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:11 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6704e26d-d0fb-4c44-9e1c-9b279087221a" returned: 0 in 0.305s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-quobyte-6704e26d-d0fb-4c44-9e1c-9b279087221a" released by "delete_volume" :: held 0.801s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:11 devstack cinder-volume[85956]: WARNING cinder.quota [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1129322711-2012635560 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1129322711-2012635560, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:49:11 devstack cinder-volume[85956]: WARNING cinder.quota [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1129322711-2012635560 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1129322711-2012635560, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Created reservations ['04661dbb-86c5-47af-b212-4a3294724f50', '23abb69f-f1c0-4bf2-bdd5-b23f287f30d9', '22c84642-681f-467f-9d53-2b66ca4eb9f1', '284898d4-2c7d-4ad0-a254-13258ccdc032'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:11 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:11 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:12 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:12 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Deleted volume successfully. Sep 17 23:49:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0b1a337a-1647-42a2-9d7b-03b0553fd091 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-6704e26d-d0fb-4c44-9e1c-9b279087221a-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Flow 'volume_create_manager' (14ee97b2-2cdc-49ff-ae5f-df2b977e18da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea50a72-1d75-42e3-aefd-922367596c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea50a72-1d75-42e3-aefd-922367596c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f412d86-3664-4b78-989b-d2984df58082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019311821e874f63a2d74e43d51ce669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:13Z,use_quota=True,user_id='25d7281fe0c947409d82608e1f6f1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f31d568-d6db-4097-84f2-90aa92b4bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f31d568-d6db-4097-84f2-90aa92b4bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55111726-7f8f-4b59-b3c1-9edcc96e4d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55111726-7f8f-4b59-b3c1-9edcc96e4d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f412d86-3664-4b78-989b-d2984df58082', 'volume_name': 'volume-5f412d86-3664-4b78-989b-d2984df58082', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f00371-51bc-4548-80a2-c7b4f5eaadc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f00371-51bc-4548-80a2-c7b4f5eaadc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c42ac0-1104-4842-8c53-15383e2f0025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Volume 5f412d86-3664-4b78-989b-d2984df58082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f412d86-3664-4b78-989b-d2984df58082', 'volume_size': 1} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f412d86-3664-4b78-989b-d2984df58082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019311821e874f63a2d74e43d51ce669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:13Z,use_quota=True,user_id='25d7281fe0c947409d82608e1f6f1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Creating volume 5f412d86-3664-4b78-989b-d2984df58082 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:49:13 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:49:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:13 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 1073741824 Sep 17 23:49:13 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:14 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 1073741824" returned: 0 in 0.893s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:14 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 Sep 17 23:49:14 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:14 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082" returned: 0 in 0.426s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c42ac0-1104-4842-8c53-15383e2f0025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f412d86-3664-4b78-989b-d2984df58082', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e6c28c-f045-414c-9c8c-6add297fb7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:14 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Volume volume-5f412d86-3664-4b78-989b-d2984df58082 (5f412d86-3664-4b78-989b-d2984df58082): created successfully Sep 17 23:49:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e6c28c-f045-414c-9c8c-6add297fb7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Flow 'volume_create_manager' (14ee97b2-2cdc-49ff-ae5f-df2b977e18da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-498a72d4-df06-47da-83b2-025972c0b817 tempest-VolumesListAdminTestJSON-1793140890 None] Created volume successfully. Sep 17 23:49:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Acquiring lock "cinder-5f412d86-3664-4b78-989b-d2984df58082-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "cinder-5f412d86-3664-4b78-989b-d2984df58082-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Acquiring lock "cinder-quobyte-5f412d86-3664-4b78-989b-d2984df58082" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "cinder-quobyte-5f412d86-3664-4b78-989b-d2984df58082" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a6ac4-889f-44a5-941c-fdcfbeec1844]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "cinder-131442ea-f49b-4ab4-9df2-6377aeafa40d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:16 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 Sep 17 23:49:16 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-131442ea-f49b-4ab4-9df2-6377aeafa40d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "cinder-quobyte-131442ea-f49b-4ab4-9df2-6377aeafa40d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-7fc1fb8f-ab60-4620-bb8c-8a6e68e2344c req-4a10760e-d886-4c0a-a29f-4a5c1f9b784c tempest-TestInstancesWithCinderVolumes-2003590849 None] Terminate volume connection completed successfully. Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-7fc1fb8f-ab60-4620-bb8c-8a6e68e2344c req-4a10760e-d886-4c0a-a29f-4a5c1f9b784c tempest-TestInstancesWithCinderVolumes-2003590849 None] Deleting attachment a52cd91d-02b3-443a-a27d-895bc5b73000. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-quobyte-131442ea-f49b-4ab4-9df2-6377aeafa40d" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d79716-57d6-458d-9f86-62443f3c2d8c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-f6885e6e-42c0-4a53-8adf-5cfc5ec2d6d3 req-52fdf529-3161-4502-90a7-0df6f7887429 tempest-AttachVolumeTestJSON-201289366 None] Terminate volume connection completed successfully. Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-f6885e6e-42c0-4a53-8adf-5cfc5ec2d6d3 req-52fdf529-3161-4502-90a7-0df6f7887429 tempest-AttachVolumeTestJSON-201289366 None] Deleting attachment d81caaf7-cfd8-47af-ba6a-e6b2800c6ab8. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:49:16 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082" returned: 0 in 0.584s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:16 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d Sep 17 23:49:16 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:16 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082 Sep 17 23:49:16 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:16 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:16 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5f412d86-3664-4b78-989b-d2984df58082" returned: 0 in 0.373s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d" returned: 0 in 0.585s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "cinder-quobyte-5f412d86-3664-4b78-989b-d2984df58082" released by "delete_volume" :: held 1.065s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:16 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d Sep 17 23:49:16 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Created reservations ['bad6657a-bdb0-443a-bb0c-1ecb08334863', '2a113e34-5af8-42b8-afdf-8751c17197fc', '95ec44ca-f2b7-44c3-9f44-7735b54125f4', 'b0065cf9-8e9d-4cab-8d31-c7b631be23c9'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:17 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-131442ea-f49b-4ab4-9df2-6377aeafa40d" returned: 0 in 0.295s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:17 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:17 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-quobyte-131442ea-f49b-4ab4-9df2-6377aeafa40d" released by "delete_volume" :: held 0.967s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Created reservations ['3df6f163-aad8-4831-971d-1326eaa5b1c7', '234b351b-5fc6-4e30-99c4-7b183277315a', 'de7936b1-04d1-4f2d-9940-4f2d8ab90194', '93b57bbc-cce6-4c45-b068-a3fd1aa98a30'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:17 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:17 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:17 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.389s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Deleted volume successfully. Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-174785c1-7423-427e-a82c-f1dea22b0664 tempest-VolumesListAdminTestJSON-1793140890 None] Lock "cinder-5f412d86-3664-4b78-989b-d2984df58082-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "cinder-b6d90831-1fc4-4a23-b39d-92599a2fae33-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-b6d90831-1fc4-4a23-b39d-92599a2fae33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "cinder-quobyte-b6d90831-1fc4-4a23-b39d-92599a2fae33" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-quobyte-b6d90831-1fc4-4a23-b39d-92599a2fae33" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:17 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.436s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c026a65-7ba7-467f-8404-71317d44308a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Deleted volume successfully. Sep 17 23:49:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ec68bb2d-e422-4036-9181-93340afc6fa2 tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-131442ea-f49b-4ab4-9df2-6377aeafa40d-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:18 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 Sep 17 23:49:18 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:18 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33" returned: 0 in 0.429s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:18 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33 Sep 17 23:49:18 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "cinder-be862770-0335-447b-9dc4-12a7efb4645e-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-be862770-0335-447b-9dc4-12a7efb4645e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "cinder-quobyte-be862770-0335-447b-9dc4-12a7efb4645e" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-quobyte-be862770-0335-447b-9dc4-12a7efb4645e" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:18 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c068b6-ac5b-4c56-b9f9-f2ab2934dd26]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b6d90831-1fc4-4a23-b39d-92599a2fae33" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-quobyte-b6d90831-1fc4-4a23-b39d-92599a2fae33" released by "delete_volume" :: held 0.857s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:18 devstack cinder-volume[85956]: WARNING cinder.quota [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45143912-1943576121 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45143912-1943576121, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:49:18 devstack cinder-volume[85956]: WARNING cinder.quota [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45143912-1943576121 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45143912-1943576121, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Created reservations ['a82eb053-5e7c-4139-8017-07086d8cf2a6', '466408c7-e9c1-44e0-a8d9-382153b2c845', 'd41afcbb-90ba-4ef2-80fb-0fd2a5809674', 'd9089701-6850-45ab-9a05-36f0e28dd986'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:18 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e Sep 17 23:49:18 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:19 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:19 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:19 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e" returned: 0 in 0.495s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:19 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e Sep 17 23:49:19 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:19 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.511s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Deleted volume successfully. Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-434b560e-c066-4911-a865-35a2c9f78ca6 tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-b6d90831-1fc4-4a23-b39d-92599a2fae33-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:19 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be862770-0335-447b-9dc4-12a7efb4645e" returned: 0 in 0.465s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-quobyte-be862770-0335-447b-9dc4-12a7efb4645e" released by "delete_volume" :: held 1.030s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Created reservations ['ba63cd41-9c1a-421c-ba35-e30288c3d358', 'f3118735-d522-439c-8174-654a7f5de648', 'c2f3563c-94b2-40b8-8498-7bffc0cde202', '35a125ad-2557-4125-9f31-44c80adc5c05'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:19 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:19 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:20 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.373s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:20 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:20 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Deleted volume successfully. Sep 17 23:49:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b1a6420d-19f1-44fa-8596-d2c7eea346cc tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-be862770-0335-447b-9dc4-12a7efb4645e-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "cinder-f6163d5a-3f48-445f-bb1a-c6428086ac0c-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-f6163d5a-3f48-445f-bb1a-c6428086ac0c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "cinder-quobyte-f6163d5a-3f48-445f-bb1a-c6428086ac0c" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-quobyte-f6163d5a-3f48-445f-bb1a-c6428086ac0c" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:21 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9732d8e-62d1-4429-ab52-09b3bf546bc5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:21 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c Sep 17 23:49:21 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:21 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c" returned: 0 in 0.507s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:21 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c Sep 17 23:49:21 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:22 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f6163d5a-3f48-445f-bb1a-c6428086ac0c" returned: 0 in 0.659s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-quobyte-f6163d5a-3f48-445f-bb1a-c6428086ac0c" released by "delete_volume" :: held 1.282s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Created reservations ['7501a72d-93b5-4e90-85dc-4bfe76fe5c91', 'ca605e38-697d-4656-9bb7-781701eeea05', '681cd0ee-1607-41dc-abdf-642af7ac5277', 'f600e413-5dfc-4ea2-84a2-0c8b8abc8e16'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:22 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:22 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:22 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.364s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:22 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:23 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Deleted volume successfully. Sep 17 23:49:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5daf8abf-aed3-4893-b810-0c5b3fb819df tempest-VolumesListAdminTestJSON-652402705 None] Lock "cinder-f6163d5a-3f48-445f-bb1a-c6428086ac0c-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-84c0fc15-1d34-4549-8303-f72ebb45dfe2 req-765e503d-5eec-4e0d-bcbe-ff582b357c06 tempest-TestInstancesWithCinderVolumes-2003590849 None] Terminate volume connection completed successfully. Sep 17 23:49:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-84c0fc15-1d34-4549-8303-f72ebb45dfe2 req-765e503d-5eec-4e0d-bcbe-ff582b357c06 tempest-TestInstancesWithCinderVolumes-2003590849 None] Deleting attachment 153d01be-ee45-4565-9f6b-854c06f4bcb9. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "cinder-3167de3b-78ef-4d64-b041-28e721434d15-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-3167de3b-78ef-4d64-b041-28e721434d15-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "cinder-quobyte-3167de3b-78ef-4d64-b041-28e721434d15" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Flow 'volume_create_manager' (b2d32290-73e3-405e-9179-da31cc7d4816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56aa927-adcd-4ccd-a850-90a9573fe2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-quobyte-3167de3b-78ef-4d64-b041-28e721434d15" acquired by "delete_volume" :: waited 0.079s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56aa927-adcd-4ccd-a850-90a9573fe2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-115856936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c810cb4b8f6740e78bd10bf9bfa69c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:28Z,use_quota=True,user_id='ca234b72ed3841c29a89b7efc570f4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310019be-cdfb-45fd-bc92-089d9a5907bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310019be-cdfb-45fd-bc92-089d9a5907bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a806084f-978a-4d64-93a9-f82a14915793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[314c223b-4053-4672-a3ec-bc823217311f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:28 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 Sep 17 23:49:28 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a806084f-978a-4d64-93a9-f82a14915793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6', 'volume_name': 'volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef07a57-ddde-49a8-b065-6134bc1fafdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef07a57-ddde-49a8-b065-6134bc1fafdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29767639-c2d9-4108-8640-7e82a180fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:28 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Volume 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Trying to clone 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:49:28 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15" returned: 0 in 0.530s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:28 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15 Sep 17 23:49:28 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:29 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:49:29 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Image download 20.69 MB at 20.69 MB/s Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3167de3b-78ef-4d64-b041-28e721434d15" returned: 0 in 0.567s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-quobyte-3167de3b-78ef-4d64-b041-28e721434d15" released by "delete_volume" :: held 1.197s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:29 devstack cinder-volume[85956]: WARNING cinder.quota [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049983003-201492733 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049983003-201492733, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:49:29 devstack cinder-volume[85956]: WARNING cinder.quota [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049983003-201492733 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049983003-201492733, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a59e2d-9340-44f2-8a3d-12359f34ecba]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Created reservations ['4a705781-7998-49aa-b030-06dbc2154560', '1cf58697-218b-4454-a578-b9ff10b01777', '9638191b-a0d2-4303-8e6f-f050f913a27a', '62bc4982-cdc4-42af-a27e-09c1d50c0b5c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:29 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD Sep 17 23:49:29 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:29 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:29 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:29 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee is fetched for user ca234b72ed3841c29a89b7efc570f4bb. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:49:29 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.291s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:29 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Deleted volume successfully. Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-928a5ad6-fbfe-40f1-a366-840d309776ee tempest-TestInstancesWithCinderVolumes-2003590849 None] Lock "cinder-3167de3b-78ef-4d64-b041-28e721434d15-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0334e08c-7375-4642-b696-900e7828b71c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:29 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD Sep 17 23:49:29 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:30 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-115856936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c810cb4b8f6740e78bd10bf9bfa69c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:28Z,use_quota=True,user_id='ca234b72ed3841c29a89b7efc570f4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Creating volume 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:49:30 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:30 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 1073741824 Sep 17 23:49:30 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:30 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 1073741824" returned: 0 in 0.536s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:30 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 Sep 17 23:49:30 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:31 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6" returned: 0 in 0.361s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Attempting download of ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1631c4c-0f1f-48eb-98df-4eee674db574]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_vk45v8vk {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:31 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_vk45v8vk Sep 17 23:49:31 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:31 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_vk45v8vk" returned: 0 in 0.517s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_vk45v8vk {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:31 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_vk45v8vk Sep 17 23:49:31 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:32 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_vk45v8vk" returned: 1 in 0.416s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_vk45v8vk' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:49:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e454e3c0-5117-463c-870c-ac8c56f25626]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:32 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD Sep 17 23:49:32 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:32 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:32 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] ecf291a3-5fd0-40b6-8d63-9625bdc973ee was qcow2, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:49:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:32 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 Sep 17 23:49:32 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Flow 'volume_create_manager' (d9e5b7ca-4e50-42fb-aaf2-6b1e41b7262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1bbb43-fe04-43c1-a9b7-17d660aa8871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1bbb43-fe04-43c1-a9b7-17d660aa8871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-576584052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08b5ed2-899b-41ee-96f1-a7ae84b267a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf515dbcaa6495eb89a1f2678316108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:33Z,use_quota=True,user_id='407c791637114dd49038efd3647e796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81264982-f4c0-44b6-a617-2c95373f1feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81264982-f4c0-44b6-a617-2c95373f1feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66421445-3264-4fd2-98f9-7927c87a1169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66421445-3264-4fd2-98f9-7927c87a1169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08b5ed2-899b-41ee-96f1-a7ae84b267a7', 'volume_name': 'volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbff328-7f54-47bc-8139-47c5bef4b95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbff328-7f54-47bc-8139-47c5bef4b95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19ee442-af5a-44df-a4b3-ab64af294661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:33 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Volume c08b5ed2-899b-41ee-96f1-a7ae84b267a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7', 'volume_size': 1} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-576584052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08b5ed2-899b-41ee-96f1-a7ae84b267a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf515dbcaa6495eb89a1f2678316108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:33Z,use_quota=True,user_id='407c791637114dd49038efd3647e796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Creating volume c08b5ed2-899b-41ee-96f1-a7ae84b267a7 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:49:33 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:49:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:33 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 1073741824 Sep 17 23:49:33 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:34 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 1073741824" returned: 0 in 0.654s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:34 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 Sep 17 23:49:34 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:34 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7" returned: 0 in 0.337s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19ee442-af5a-44df-a4b3-ab64af294661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357eb180-0c05-42d0-8eb0-809a2834c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:34 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Volume volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 (c08b5ed2-899b-41ee-96f1-a7ae84b267a7): created successfully Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357eb180-0c05-42d0-8eb0-809a2834c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Flow 'volume_create_manager' (d9e5b7ca-4e50-42fb-aaf2-6b1e41b7262f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:34 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9f5af33e-190d-4d14-89dd-06a95acb12d1 tempest-VolumesTransfersV357Test-91178444 None] Created volume successfully. Sep 17 23:49:34 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6" returned: 0 in 2.317s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ecf291a3-5fd0-40b6-8d63-9625bdc973ee_dg2naix0devstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:49:34 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Converted 112.00 MB image at 48.32 MB/s Sep 17 23:49:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:35 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 1G Sep 17 23:49:35 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:35 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 1G" returned: 0 in 0.371s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Downloaded image ecf291a3-5fd0-40b6-8d63-9625bdc973ee ((None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}])) to volume 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Temporary image ecf291a3-5fd0-40b6-8d63-9625bdc973ee for user ca234b72ed3841c29a89b7efc570f4bb is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Marking volume 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Copying metadata from image ecf291a3-5fd0-40b6-8d63-9625bdc973ee to 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Creating volume glance metadata for volume 99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 backed by image ecf291a3-5fd0-40b6-8d63-9625bdc973ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29767639-c2d9-4108-8640-7e82a180fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6', 'volume_size': 1, 'image_id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4122271dbc5c45668bf9ebc3d1ac6798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecf291a3-5fd0-40b6-8d63-9625bdc973ee', 'created_at': datetime.datetime(2026, 9, 17, 21, 33, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecf291a3-5fd0-40b6-8d63-9625bdc973ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc0a0b4-72fb-4efc-972d-4328928f10e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:35 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Volume volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 (99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6): created successfully Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc0a0b4-72fb-4efc-972d-4328928f10e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Flow 'volume_create_manager' (b2d32290-73e3-405e-9179-da31cc7d4816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6fc5cf26-799d-462c-a13a-46c6956a0627 tempest-TestShelveInstance-911222449 None] Created volume successfully. Sep 17 23:49:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a87043fb-2a8c-403a-9d0a-cf513bdc7870 tempest-VolumesTransfersV357Test-1953551933 None] Transfer volume completed successfully. Sep 17 23:49:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Acquiring lock "cinder-c08b5ed2-899b-41ee-96f1-a7ae84b267a7-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-c08b5ed2-899b-41ee-96f1-a7ae84b267a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Acquiring lock "cinder-quobyte-c08b5ed2-899b-41ee-96f1-a7ae84b267a7" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-quobyte-c08b5ed2-899b-41ee-96f1-a7ae84b267a7" acquired by "delete_volume" :: waited 0.038s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:37 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[327599de-d704-4de4-9686-69e5583820da]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:37 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 Sep 17 23:49:37 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:37 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7" returned: 0 in 0.548s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:37 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7 Sep 17 23:49:37 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:37 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c08b5ed2-899b-41ee-96f1-a7ae84b267a7" returned: 0 in 0.344s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-quobyte-c08b5ed2-899b-41ee-96f1-a7ae84b267a7" released by "delete_volume" :: held 0.979s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Created reservations ['d8096f9c-f407-4cf4-97b5-0642ca3d4530', '2b9e6a80-36d1-43b7-b4cc-b3b1f9250dcd', '2f6d1d07-85af-4191-bdfe-49a588be9cc4', '558efcd6-fef6-4eea-9f6e-890aac34c2af'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:38 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:38 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:38 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.415s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Deleted volume successfully. Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-44421506-bbf9-4ce5-bccb-19756088acae tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-c08b5ed2-899b-41ee-96f1-a7ae84b267a7-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Flow 'volume_create_manager' (7c03cdbe-1725-47d6-b4e2-e560ae00aefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62c0894-7ace-499e-a4c6-3839a0d0e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62c0894-7ace-499e-a4c6-3839a0d0e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1612792304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851049f9-2c86-4e03-a975-6e127fae88d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf515dbcaa6495eb89a1f2678316108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:39Z,use_quota=True,user_id='407c791637114dd49038efd3647e796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1365ff10-a4f7-4370-a906-956c3ae45385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1365ff10-a4f7-4370-a906-956c3ae45385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91648e91-2acd-4c01-82c3-15e2c521b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91648e91-2acd-4c01-82c3-15e2c521b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851049f9-2c86-4e03-a975-6e127fae88d4', 'volume_name': 'volume-851049f9-2c86-4e03-a975-6e127fae88d4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa077ca-a231-40f2-ad30-4b6e9a35a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa077ca-a231-40f2-ad30-4b6e9a35a87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dde9d3a-2c6b-4008-af0d-e4dad8542b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Volume 851049f9-2c86-4e03-a975-6e127fae88d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851049f9-2c86-4e03-a975-6e127fae88d4', 'volume_size': 1} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1612792304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851049f9-2c86-4e03-a975-6e127fae88d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf515dbcaa6495eb89a1f2678316108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:49:39Z,use_quota=True,user_id='407c791637114dd49038efd3647e796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Creating volume 851049f9-2c86-4e03-a975-6e127fae88d4 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:49:39 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:39 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 1073741824 Sep 17 23:49:39 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:39 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 1073741824" returned: 0 in 0.587s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:39 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 Sep 17 23:49:39 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:39 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4" returned: 0 in 0.279s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dde9d3a-2c6b-4008-af0d-e4dad8542b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851049f9-2c86-4e03-a975-6e127fae88d4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34604211-63b1-4ad7-be85-425a64c4baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:49:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Volume volume-851049f9-2c86-4e03-a975-6e127fae88d4 (851049f9-2c86-4e03-a975-6e127fae88d4): created successfully Sep 17 23:49:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34604211-63b1-4ad7-be85-425a64c4baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:49:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Flow 'volume_create_manager' (7c03cdbe-1725-47d6-b4e2-e560ae00aefa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:49:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-628a95d8-fa43-4bc1-b6b0-1d1f6a93fb9f tempest-VolumesTransfersV357Test-91178444 None] Created volume successfully. Sep 17 23:49:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6a5a0f38-2ace-429f-95b1-8a7fd3b99241 req-bbc3a2c4-0ca3-4dc8-b980-e23c983208af tempest-TestShelveInstance-911222449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6a5a0f38-2ace-429f-95b1-8a7fd3b99241 req-bbc3a2c4-0ca3-4dc8-b980-e23c983208af tempest-TestShelveInstance-911222449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6a5a0f38-2ace-429f-95b1-8a7fd3b99241 req-bbc3a2c4-0ca3-4dc8-b980-e23c983208af tempest-TestShelveInstance-911222449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-6a5a0f38-2ace-429f-95b1-8a7fd3b99241 req-bbc3a2c4-0ca3-4dc8-b980-e23c983208af tempest-TestShelveInstance-911222449 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18663ae5-0ef3-4f49-a67d-b9b5f39c1614', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:49:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-6a5a0f38-2ace-429f-95b1-8a7fd3b99241 req-bbc3a2c4-0ca3-4dc8-b980-e23c983208af tempest-TestShelveInstance-911222449 None] attachment_update completed successfully. Sep 17 23:49:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Acquiring lock "cinder-851049f9-2c86-4e03-a975-6e127fae88d4-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-851049f9-2c86-4e03-a975-6e127fae88d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Acquiring lock "cinder-quobyte-851049f9-2c86-4e03-a975-6e127fae88d4" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:49:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-quobyte-851049f9-2c86-4e03-a975-6e127fae88d4" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:49:41 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3ec965-4b12-41af-b941-155e517a2744]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:49:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:41 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 Sep 17 23:49:41 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:42 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4" returned: 0 in 0.452s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:42 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4 Sep 17 23:49:42 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:42 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:42 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:42 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-851049f9-2c86-4e03-a975-6e127fae88d4" returned: 0 in 0.309s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-quobyte-851049f9-2c86-4e03-a975-6e127fae88d4" released by "delete_volume" :: held 0.844s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Created reservations ['3a6c14e4-a870-4a2a-84c2-efdc8dea490d', 'f4f721b6-2ea0-4d63-9be3-54d033e9823e', '6bc4a88f-b82f-4758-b41b-1a3eb228d45a', '454fc187-2700-4044-bdd4-2cef08dfccba'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:49:42 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.410s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:42 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:49:42 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:49:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:49:43 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 17 23:49:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.457s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:49:43 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:49:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Deleted volume successfully. Sep 17 23:49:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0d251c88-c2d7-48d1-bb19-b6815f3d877e tempest-VolumesTransfersV357Test-1785462725 None] Lock "cinder-851049f9-2c86-4e03-a975-6e127fae88d4-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:49:52 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=86,cinder:UPDATE=96,cinder:INSERT=27,cinder:DELETE=7 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:49:53 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=95,cinder:UPDATE=102,cinder:DELETE=9,cinder:INSERT=29 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Flow 'volume_create_manager' (b122a5a7-8c4d-41d4-bb91-9d6e5d2de890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bdb2f6-7c93-4eaa-bfe7-6d28be1032b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bdb2f6-7c93-4eaa-bfe7-6d28be1032b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691087590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf8aadd-3290-47cd-96d7-c95dbbb669b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14c346b47374ddfac2697626137b942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:11Z,use_quota=True,user_id='aaa1a1b9bf104d1c8fd1dd3056f2705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f4c41-c06f-4033-b296-bc5c335e4439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f4c41-c06f-4033-b296-bc5c335e4439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0eee89-ce05-4459-b4e1-c690f5cd36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0eee89-ce05-4459-b4e1-c690f5cd36e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf8aadd-3290-47cd-96d7-c95dbbb669b8', 'volume_name': 'volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd3217-af5d-4d60-afd7-816a8f0f0321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd3217-af5d-4d60-afd7-816a8f0f0321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe4f757-6c12-463f-a606-3ef24a7a8492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Volume 0bf8aadd-3290-47cd-96d7-c95dbbb669b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8', 'volume_size': 1} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691087590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf8aadd-3290-47cd-96d7-c95dbbb669b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14c346b47374ddfac2697626137b942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:11Z,use_quota=True,user_id='aaa1a1b9bf104d1c8fd1dd3056f2705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Creating volume 0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:50:10 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:50:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:10 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 1073741824 Sep 17 23:50:10 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:11 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 1073741824" returned: 0 in 0.542s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:11 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:50:11 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:11 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.337s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe4f757-6c12-463f-a606-3ef24a7a8492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7123f486-372a-4965-9296-ed02e02ef720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Volume volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 (0bf8aadd-3290-47cd-96d7-c95dbbb669b8): created successfully Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7123f486-372a-4965-9296-ed02e02ef720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Flow 'volume_create_manager' (b122a5a7-8c4d-41d4-bb91-9d6e5d2de890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-01594683-2357-4540-b60a-6a559a2c864e tempest-VolumesActionsTest-1571028866 None] Created volume successfully. Sep 17 23:50:21 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:50:22 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Flow 'volume_create_manager' (1f75ae5c-c247-43db-b5e3-2d970883c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a889c4-3487-418e-b6ac-48f2d8ade371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a889c4-3487-418e-b6ac-48f2d8ade371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-5226195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba67596a4ef143a1927652dcbdedd9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:23Z,use_quota=True,user_id='b6124734949240a3a336fd6e23aa6d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb32ad-28df-42a5-86ee-1573d2cf011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb32ad-28df-42a5-86ee-1573d2cf011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7560d67-bcfd-4caf-94dc-68a0466b129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7560d67-bcfd-4caf-94dc-68a0466b129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4', 'volume_name': 'volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e991d05-278f-426b-b355-9e6607596c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e991d05-278f-426b-b355-9e6607596c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd17ca9d-680e-4651-b438-e59351fe1d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:23 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Volume 953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4', 'volume_size': 1} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-5226195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba67596a4ef143a1927652dcbdedd9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:23Z,use_quota=True,user_id='b6124734949240a3a336fd6e23aa6d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Creating volume 953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:50:23 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:50:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:23 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 1073741824 Sep 17 23:50:23 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-9a0ea235-31e6-49df-aa3b-1b13c8e34da4 req-ea4ae631-0e28-4be9-8d12-330a9b435279 tempest-TestShelveInstance-911222449 None] Terminate volume connection completed successfully. Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-9a0ea235-31e6-49df-aa3b-1b13c8e34da4 req-ea4ae631-0e28-4be9-8d12-330a9b435279 tempest-TestShelveInstance-911222449 None] Deleting attachment 18663ae5-0ef3-4f49-a67d-b9b5f39c1614. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:50:24 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 1073741824" returned: 0 in 1.025s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:24 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 Sep 17 23:50:24 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:24 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" returned: 0 in 0.391s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd17ca9d-680e-4651-b438-e59351fe1d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ffdcc9-2763-45b5-be19-545d8c4657e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Volume volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 (953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4): created successfully Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ffdcc9-2763-45b5-be19-545d8c4657e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Flow 'volume_create_manager' (1f75ae5c-c247-43db-b5e3-2d970883c027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c543c8b3-17bf-4207-812d-d45e4a828551 tempest-TestStampPattern-1795639914 None] Created volume successfully. Sep 17 23:50:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-4d09a403-5ab6-4972-ad06-b4d5d2398f49 req-5d34ce66-c681-45c1-8c08-012107099520 tempest-TestShelveInstance-911222449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-4d09a403-5ab6-4972-ad06-b4d5d2398f49 req-5d34ce66-c681-45c1-8c08-012107099520 tempest-TestShelveInstance-911222449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-4d09a403-5ab6-4972-ad06-b4d5d2398f49 req-5d34ce66-c681-45c1-8c08-012107099520 tempest-TestShelveInstance-911222449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-4d09a403-5ab6-4972-ad06-b4d5d2398f49 req-5d34ce66-c681-45c1-8c08-012107099520 tempest-TestShelveInstance-911222449 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd084ed86-1de1-435a-9f82-55b0806c7dfc', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:50:29 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-4d09a403-5ab6-4972-ad06-b4d5d2398f49 req-5d34ce66-c681-45c1-8c08-012107099520 tempest-TestShelveInstance-911222449 None] attachment_update completed successfully. Sep 17 23:50:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c52fe836-0794-4648-a088-406ff074afbe tempest-VolumesActionsTest-1571028866 None] Acquiring lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" by "attach_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:50:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c52fe836-0794-4648-a088-406ff074afbe tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" acquired by "attach_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:50:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c52fe836-0794-4648-a088-406ff074afbe tempest-VolumesActionsTest-1571028866 None] Attaching volume 0bf8aadd-3290-47cd-96d7-c95dbbb669b8 to instance 6d9641b0-b12e-4598-95c5-5b086686bfc9 at mountpoint /dev/vdb on host None. Sep 17 23:50:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c52fe836-0794-4648-a088-406ff074afbe tempest-VolumesActionsTest-1571028866 None] Attach volume completed successfully. Sep 17 23:50:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c52fe836-0794-4648-a088-406ff074afbe tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" released by "attach_volume" :: held 0.126s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:50:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-300cb3e5-5980-4dd4-9f4c-ca5516e5bba9 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-detach_volume" by "detach_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:50:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-300cb3e5-5980-4dd4-9f4c-ca5516e5bba9 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:50:34 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-300cb3e5-5980-4dd4-9f4c-ca5516e5bba9 tempest-VolumesActionsTest-1571028866 None] Detaching volume 0bf8aadd-3290-47cd-96d7-c95dbbb669b8 from instance 6d9641b0-b12e-4598-95c5-5b086686bfc9. Sep 17 23:50:34 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-300cb3e5-5980-4dd4-9f4c-ca5516e5bba9 tempest-VolumesActionsTest-1571028866 None] Detach volume completed successfully. Sep 17 23:50:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-300cb3e5-5980-4dd4-9f4c-ca5516e5bba9 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:42 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:50:42 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:42 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.676s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:50:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:50:44 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=4,cinder:SELECT=16,cinder:DELETE=1,cinder:INSERT=2 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:50:44 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=16,cinder:INSERT=1,cinder:UPDATE=11 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:50:47 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:50:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Flow 'volume_create_manager' (0818e664-f82e-4aaf-a3b2-e1d4a88b69cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aab0807-c0a2-478d-acb5-d82d09549caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aab0807-c0a2-478d-acb5-d82d09549caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-134053741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ff54f6-2b66-4a9b-9ce8-180a06074971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a9c90bfed640e9bc27e845cd865f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:48Z,use_quota=True,user_id='0697e5934bfa47baada2642f6a198499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210fe730-7635-404b-bcb2-a2dfab5ca71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210fe730-7635-404b-bcb2-a2dfab5ca71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f9fb37-080e-4439-8ef1-6d18ed61da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f9fb37-080e-4439-8ef1-6d18ed61da1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ff54f6-2b66-4a9b-9ce8-180a06074971', 'volume_name': 'volume-07ff54f6-2b66-4a9b-9ce8-180a06074971', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634a08eb-b3a4-4af8-81a7-c6a3d2039332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634a08eb-b3a4-4af8-81a7-c6a3d2039332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99c6ab1-2773-4aac-bf58-871a569bb7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:48 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Volume 07ff54f6-2b66-4a9b-9ce8-180a06074971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ff54f6-2b66-4a9b-9ce8-180a06074971', 'volume_size': 1} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-134053741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ff54f6-2b66-4a9b-9ce8-180a06074971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a9c90bfed640e9bc27e845cd865f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:48Z,use_quota=True,user_id='0697e5934bfa47baada2642f6a198499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Creating volume 07ff54f6-2b66-4a9b-9ce8-180a06074971 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:50:48 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:48 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 1073741824 Sep 17 23:50:48 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:48 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 1073741824" returned: 0 in 0.651s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:48 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 Sep 17 23:50:48 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:49 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971" returned: 0 in 0.844s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:50:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99c6ab1-2773-4aac-bf58-871a569bb7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ff54f6-2b66-4a9b-9ce8-180a06074971', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b154e6-f2cc-4784-aceb-247c0f512ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:49 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Volume volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 (07ff54f6-2b66-4a9b-9ce8-180a06074971): created successfully Sep 17 23:50:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b154e6-f2cc-4784-aceb-247c0f512ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Flow 'volume_create_manager' (0818e664-f82e-4aaf-a3b2-e1d4a88b69cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:49 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1fcd4b53-a3a0-4008-a721-f1fa7a573e41 tempest-AttachVolumeTestJSON-201289366 None] Created volume successfully. Sep 17 23:50:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-54a4e1b6-e190-48dd-9bdd-a0599e2648cc req-fb8e8d76-8b19-4a11-affa-83a2d9c796e1 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-54a4e1b6-e190-48dd-9bdd-a0599e2648cc req-fb8e8d76-8b19-4a11-affa-83a2d9c796e1 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-54a4e1b6-e190-48dd-9bdd-a0599e2648cc req-fb8e8d76-8b19-4a11-affa-83a2d9c796e1 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:52 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-54a4e1b6-e190-48dd-9bdd-a0599e2648cc req-fb8e8d76-8b19-4a11-affa-83a2d9c796e1 tempest-AttachVolumeTestJSON-201289366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-07ff54f6-2b66-4a9b-9ce8-180a06074971', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4d61cc1-2f16-48bc-962e-5ebadfb290d1', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:50:52 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-54a4e1b6-e190-48dd-9bdd-a0599e2648cc req-fb8e8d76-8b19-4a11-affa-83a2d9c796e1 tempest-AttachVolumeTestJSON-201289366 None] attachment_update completed successfully. Sep 17 23:50:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7c93a88a-b7c7-472e-9185-f2ea753bace1 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" by "attach_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:50:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7c93a88a-b7c7-472e-9185-f2ea753bace1 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" acquired by "attach_volume" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:50:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7c93a88a-b7c7-472e-9185-f2ea753bace1 tempest-VolumesActionsTest-1571028866 None] Attaching volume 0bf8aadd-3290-47cd-96d7-c95dbbb669b8 to instance 95907f80-072f-4c5e-8999-0b9184f8f1a9 at mountpoint /dev/vdb on host None. Sep 17 23:50:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7c93a88a-b7c7-472e-9185-f2ea753bace1 tempest-VolumesActionsTest-1571028866 None] Attach volume completed successfully. Sep 17 23:50:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7c93a88a-b7c7-472e-9185-f2ea753bace1 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" released by "attach_volume" :: held 0.150s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:50:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7663db01-5664-4688-adf2-837f7f6c6b56 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-detach_volume" by "detach_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:50:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7663db01-5664-4688-adf2-837f7f6c6b56 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:50:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7663db01-5664-4688-adf2-837f7f6c6b56 tempest-VolumesActionsTest-1571028866 None] Detaching volume 0bf8aadd-3290-47cd-96d7-c95dbbb669b8 from instance 95907f80-072f-4c5e-8999-0b9184f8f1a9. Sep 17 23:50:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7663db01-5664-4688-adf2-837f7f6c6b56 tempest-VolumesActionsTest-1571028866 None] Detach volume completed successfully. Sep 17 23:50:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7663db01-5664-4688-adf2-837f7f6c6b56 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Flow 'volume_create_manager' (ee8a1ed3-1061-41a3-a664-9e947fea3d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bf75c7-bbc8-48dc-bda6-0ea94845af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bf75c7-bbc8-48dc-bda6-0ea94845af27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2105529398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05244d37-5866-4050-9fc7-3da90ec23a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a9c90bfed640e9bc27e845cd865f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:56Z,use_quota=True,user_id='0697e5934bfa47baada2642f6a198499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2496ff2-596d-46b9-a3f2-a3f14dfc4cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2496ff2-596d-46b9-a3f2-a3f14dfc4cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7219cc-e979-43e4-af57-70c5522b55a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7219cc-e979-43e4-af57-70c5522b55a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05244d37-5866-4050-9fc7-3da90ec23a2d', 'volume_name': 'volume-05244d37-5866-4050-9fc7-3da90ec23a2d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53018410-14eb-4c21-a61a-152c1fb42914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53018410-14eb-4c21-a61a-152c1fb42914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85534fb7-c556-463b-a157-33436a14b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:55 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Volume 05244d37-5866-4050-9fc7-3da90ec23a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05244d37-5866-4050-9fc7-3da90ec23a2d', 'volume_size': 1} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2105529398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05244d37-5866-4050-9fc7-3da90ec23a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a9c90bfed640e9bc27e845cd865f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:50:56Z,use_quota=True,user_id='0697e5934bfa47baada2642f6a198499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Creating volume 05244d37-5866-4050-9fc7-3da90ec23a2d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:50:55 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:50:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:55 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d 1073741824 Sep 17 23:50:55 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:56 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d 1073741824" returned: 0 in 0.527s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:56 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d Sep 17 23:50:56 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:56 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d" returned: 0 in 0.326s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85534fb7-c556-463b-a157-33436a14b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05244d37-5866-4050-9fc7-3da90ec23a2d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c53f05-2ba9-4aa1-a7f9-995027dd9717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:50:56 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Volume volume-05244d37-5866-4050-9fc7-3da90ec23a2d (05244d37-5866-4050-9fc7-3da90ec23a2d): created successfully Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c53f05-2ba9-4aa1-a7f9-995027dd9717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:50:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Flow 'volume_create_manager' (ee8a1ed3-1061-41a3-a664-9e947fea3d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:50:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7614bb8a-87c7-4209-b9fe-f6e5494cfe1b tempest-AttachVolumeTestJSON-201289366 None] Created volume successfully. Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-fe898e9f-59dc-47f3-8a6f-7452ac607e14 req-37f0ee03-d90c-4818-88a2-7f15ff6539d7 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-fe898e9f-59dc-47f3-8a6f-7452ac607e14 req-37f0ee03-d90c-4818-88a2-7f15ff6539d7 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-fe898e9f-59dc-47f3-8a6f-7452ac607e14 req-37f0ee03-d90c-4818-88a2-7f15ff6539d7 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-fe898e9f-59dc-47f3-8a6f-7452ac607e14 req-37f0ee03-d90c-4818-88a2-7f15ff6539d7 tempest-AttachVolumeTestJSON-201289366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-05244d37-5866-4050-9fc7-3da90ec23a2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29ed47e9-6baa-4b7b-9dba-aaf710ff1909', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a6e04-a186-427d-8646-60b50ffdffe5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:50:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:58 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-fe898e9f-59dc-47f3-8a6f-7452ac607e14 req-37f0ee03-d90c-4818-88a2-7f15ff6539d7 tempest-AttachVolumeTestJSON-201289366 None] attachment_update completed successfully. Sep 17 23:50:58 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:50:58 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:59 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.426s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[264c5655-5aa4-4af8-aa52-15ff3a1ee229]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:50:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:59 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:50:59 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:50:59 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 17 23:50:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.427s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:50:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.4b4a176a-6bbf-4e82-add2-e8717524f9cb8b4waqlq.img {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:50:59 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.4b4a176a-6bbf-4e82-add2-e8717524f9cb8b4waqlq.img Sep 17 23:50:59 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-ecd3ecbb-790b-4325-bdf3-b0a86b18a327 req-b98e0901-3512-497d-b0d1-f14ef79093dd tempest-AttachVolumeTestJSON-201289366 None] Terminate volume connection completed successfully. Sep 17 23:51:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-ecd3ecbb-790b-4325-bdf3-b0a86b18a327 req-b98e0901-3512-497d-b0d1-f14ef79093dd tempest-AttachVolumeTestJSON-201289366 None] Deleting attachment e4d61cc1-2f16-48bc-962e-5ebadfb290d1. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:51:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-e1a6453d-50a3-49f4-a8b7-709e874142da req-696b724e-dd02-4854-bf70-70e80aff1169 tempest-AttachVolumeTestJSON-201289366 None] Terminate volume connection completed successfully. Sep 17 23:51:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-e1a6453d-50a3-49f4-a8b7-709e874142da req-696b724e-dd02-4854-bf70-70e80aff1169 tempest-AttachVolumeTestJSON-201289366 None] Deleting attachment 29ed47e9-6baa-4b7b-9dba-aaf710ff1909. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:51:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1ccc294f-673a-4ba9-9e65-a0a993e52b85 req-a795e82e-4c6a-4d9f-be62-9a041a839cb6 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:08 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.4b4a176a-6bbf-4e82-add2-e8717524f9cb8b4waqlq.img" returned: 0 in 8.423s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7196dc26-3af5-45c4-9b28-b3ce8e05b5d0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:08 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:51:08 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:08 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.611s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:08 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.4b4a176a-6bbf-4e82-add2-e8717524f9cb8b4waqlq.img {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:51:08 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Converted 1024.00 MB image at 121.55 MB/s Sep 17 23:51:08 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] 4b4a176a-6bbf-4e82-add2-e8717524f9cb was raw, no need to convert to raw {{(pid=85956) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 23:51:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "cinder-05244d37-5866-4050-9fc7-3da90ec23a2d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-05244d37-5866-4050-9fc7-3da90ec23a2d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "cinder-quobyte-05244d37-5866-4050-9fc7-3da90ec23a2d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-quobyte-05244d37-5866-4050-9fc7-3da90ec23a2d" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c48c45-8956-423c-99a1-f919b2631ffb]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:10 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d Sep 17 23:51:10 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:10 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d" returned: 0 in 0.388s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:10 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d Sep 17 23:51:10 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:10 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-05244d37-5866-4050-9fc7-3da90ec23a2d" returned: 0 in 0.259s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-quobyte-05244d37-5866-4050-9fc7-3da90ec23a2d" released by "delete_volume" :: held 0.702s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Created reservations ['d8d72cd8-401e-418b-986b-d508b37c16be', '919852f5-5b9b-47a5-a668-cb3ab635f40d', '3311b639-1d4c-405a-843d-59d951a0b63e', 'ba1c9d05-3dab-4f61-ac84-02b6ac4b5409'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:10 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:10 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "cinder-07ff54f6-2b66-4a9b-9ce8-180a06074971-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-07ff54f6-2b66-4a9b-9ce8-180a06074971-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:11 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.302s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Deleted volume successfully. Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "cinder-quobyte-07ff54f6-2b66-4a9b-9ce8-180a06074971" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62a318df-9e07-4934-a9db-0ee484c6c1f8 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-05244d37-5866-4050-9fc7-3da90ec23a2d-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-quobyte-07ff54f6-2b66-4a9b-9ce8-180a06074971" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[60662c95-bc46-4ec7-b478-fe9253b72284]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:11 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 Sep 17 23:51:11 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:11 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971" returned: 0 in 0.401s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:11 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971 Sep 17 23:51:11 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:12 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-07ff54f6-2b66-4a9b-9ce8-180a06074971" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-quobyte-07ff54f6-2b66-4a9b-9ce8-180a06074971" released by "delete_volume" :: held 0.748s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Created reservations ['3c6223f8-0e21-4464-a83d-d80de4bceaaa', '4ac11d44-96b7-48c3-9d9f-f03a49b6e314', '9d059922-2007-44a0-b8f5-babbb4cd327f', 'dd76517c-376b-4c53-b7ce-514fbf61b6b5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:12 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:12 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:12 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.294s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Deleted volume successfully. Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "cinder-8254207d-a453-4972-a423-fec478e60271-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fa50e29f-2cb1-4cae-bb7e-554ac72ecf92 tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-07ff54f6-2b66-4a9b-9ce8-180a06074971-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-8254207d-a453-4972-a423-fec478e60271-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "cinder-quobyte-8254207d-a453-4972-a423-fec478e60271" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-quobyte-8254207d-a453-4972-a423-fec478e60271" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6f8f87-3272-4977-a893-fbf2a85e718d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:12 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 Sep 17 23:51:12 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:13 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271" returned: 0 in 0.399s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:13 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271 Sep 17 23:51:13 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:13 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8254207d-a453-4972-a423-fec478e60271" returned: 0 in 0.272s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-quobyte-8254207d-a453-4972-a423-fec478e60271" released by "delete_volume" :: held 0.717s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Created reservations ['3da5e9ae-58dc-4b13-acb8-5a025256c78c', '0d0e5421-f372-4b41-9e65-8d506471b815', '091a0ec8-3b2a-4d1a-afcc-b1764f4073da', '509e172b-ee5e-4ad1-9023-b952dde7ac7f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:13 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:13 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:13 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.282s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:13 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Deleted volume successfully. Sep 17 23:51:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-794e8c35-a381-4eea-96bb-f0cfe10d395a tempest-AttachVolumeTestJSON-201289366 None] Lock "cinder-8254207d-a453-4972-a423-fec478e60271-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:21 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-2f90c998-3fef-44d7-baa7-3ef1edaeb4f2 tempest-TestShelveInstance-911222449 None] Terminate volume connection completed successfully. Sep 17 23:51:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-2f90c998-3fef-44d7-baa7-3ef1edaeb4f2 tempest-TestShelveInstance-911222449 None] Deleting attachment d084ed86-1de1-435a-9f82-55b0806c7dfc. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:51:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Acquiring lock "cinder-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Lock "cinder-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Acquiring lock "cinder-quobyte-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Lock "cinder-quobyte-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:21 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbf82c4-ef02-4d99-b8e7-e8fd6ad729de]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:21 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 Sep 17 23:51:21 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:22 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6" returned: 0 in 0.639s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:22 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6 Sep 17 23:51:22 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:22 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6" returned: 0 in 0.479s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Lock "cinder-quobyte-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6" released by "delete_volume" :: held 1.207s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:23 devstack cinder-volume[85956]: DEBUG cinder.quota [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Created reservations ['b79cd33d-6304-4604-9b07-50cab6d23ddb', 'b9e54576-7e75-40a8-b789-51356875134d', 'cc664458-f635-43f3-8c13-434f7142de65', 'b23fb4aa-5664-463b-9c7d-de741d33acb8'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:51:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:23 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:23 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:24 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.384s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.manager [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Deleted volume successfully. Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-1692ecab-a0a9-47b3-8c8b-fe503b30c2a8 req-59694885-434d-4936-9db5-afddfd214b31 tempest-TestShelveInstance-911222449 None] Lock "cinder-99e6c13e-2cc2-41e1-8b5b-1cb8bb02a6a6-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Flow 'volume_create_manager' (4bbfa73a-54de-464f-8495-553eae891c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d46083-7515-451f-bb16-86b463ba9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d46083-7515-451f-bb16-86b463ba9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-676452681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4ffa17-8348-4841-b18d-c0e72610b766,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb8a18ac4c2c4d45a054d321f6139a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:24Z,use_quota=True,user_id='4d0b4d6524c44be7a57137f4bb1a7e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6113fc-776a-4c66-96fd-33cba0fda221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6113fc-776a-4c66-96fd-33cba0fda221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff304c98-f38e-4721-ba53-52277dda8bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff304c98-f38e-4721-ba53-52277dda8bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4ffa17-8348-4841-b18d-c0e72610b766', 'volume_name': 'volume-bc4ffa17-8348-4841-b18d-c0e72610b766', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38cd835e-90c3-4a48-8cbb-59bf310593be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38cd835e-90c3-4a48-8cbb-59bf310593be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f30a3da-cee2-4e9e-8db1-bc390a73c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Volume bc4ffa17-8348-4841-b18d-c0e72610b766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4ffa17-8348-4841-b18d-c0e72610b766', 'volume_size': 1} Sep 17 23:51:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.269s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Uploaded volume to glance image-id: 4b4a176a-6bbf-4e82-add2-e8717524f9cb. {{(pid=85956) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 23:51:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1ccc294f-673a-4ba9-9e65-a0a993e52b85 req-a795e82e-4c6a-4d9f-be62-9a041a839cb6 tempest-TestStampPattern-1795639914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 26.303s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-1ccc294f-673a-4ba9-9e65-a0a993e52b85 req-a795e82e-4c6a-4d9f-be62-9a041a839cb6 tempest-TestStampPattern-1795639914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.564s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-676452681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4ffa17-8348-4841-b18d-c0e72610b766,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb8a18ac4c2c4d45a054d321f6139a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:24Z,use_quota=True,user_id='4d0b4d6524c44be7a57137f4bb1a7e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Creating volume bc4ffa17-8348-4841-b18d-c0e72610b766 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:51:32 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5fc441cf-9d7a-492e-8723-6726a5a665b6 tempest-VolumesActionsTest-1571028866 None] Copy volume to image completed successfully. Sep 17 23:51:32 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 1073741824 Sep 17 23:51:32 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-1ccc294f-673a-4ba9-9e65-a0a993e52b85 req-a795e82e-4c6a-4d9f-be62-9a041a839cb6 tempest-TestStampPattern-1795639914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c5fc918-1196-406d-8f10-601e55f60c89', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:51:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-1ccc294f-673a-4ba9-9e65-a0a993e52b85 req-a795e82e-4c6a-4d9f-be62-9a041a839cb6 tempest-TestStampPattern-1795639914 None] attachment_update completed successfully. Sep 17 23:51:32 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 1073741824" returned: 0 in 0.651s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:32 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 Sep 17 23:51:32 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:33 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766" returned: 0 in 0.355s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f30a3da-cee2-4e9e-8db1-bc390a73c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4ffa17-8348-4841-b18d-c0e72610b766', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c35344-3f99-4d56-bca5-46ede9205e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:33 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Volume volume-bc4ffa17-8348-4841-b18d-c0e72610b766 (bc4ffa17-8348-4841-b18d-c0e72610b766): created successfully Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c35344-3f99-4d56-bca5-46ede9205e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Flow 'volume_create_manager' (4bbfa73a-54de-464f-8495-553eae891c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-12dbad91-5710-40d8-ae49-92d8c89e0b5d req-461d9258-ac16-48ac-9474-129ae41acbfe tempest-VolumesGetTestJSON-133637106 None] Created volume successfully. Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[762e49d2-1672-4a23-85f1-2e30e245c4e8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:33 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:51:33 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:34 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.434s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc39ae9d-fa0a-48b6-8c06-89d5a8f338de]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:34 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:51:34 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:34 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Acquiring lock "cinder-bc4ffa17-8348-4841-b18d-c0e72610b766-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.600s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Lock "cinder-bc4ffa17-8348-4841-b18d-c0e72610b766-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:34 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img Sep 17 23:51:34 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Acquiring lock "cinder-quobyte-bc4ffa17-8348-4841-b18d-c0e72610b766" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Lock "cinder-quobyte-bc4ffa17-8348-4841-b18d-c0e72610b766" acquired by "delete_volume" :: waited 0.035s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a70d0a6-a14f-47f8-a0c1-690216306bc5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:35 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 Sep 17 23:51:35 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:35 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766" returned: 0 in 0.987s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:36 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766 Sep 17 23:51:36 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:36 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-bc4ffa17-8348-4841-b18d-c0e72610b766" returned: 0 in 0.696s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Lock "cinder-quobyte-bc4ffa17-8348-4841-b18d-c0e72610b766" released by "delete_volume" :: held 1.767s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:36 devstack cinder-volume[85956]: DEBUG cinder.quota [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Created reservations ['27b3a57b-ee69-4164-9296-52129467d028', '63261dcf-f38d-403f-908a-b33893efc395', '5ae63c8e-b2c2-45c9-a6ca-955018f7a508', '5aa4d5e0-1709-48fd-810b-d3a80efebaad'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:37 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:37 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:37 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.685s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG cinder.manager [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Deleted volume successfully. Sep 17 23:51:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [req-6123d7f4-5ae0-47cf-8693-69f1b26b7809 req-c5a79738-dd26-4eba-a122-a31da2c0c389 tempest-VolumesGetTestJSON-133637106 None] Lock "cinder-bc4ffa17-8348-4841-b18d-c0e72610b766-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-e776b939-021c-4639-a137-bab74548d81b req-9182ba6d-5d20-4a1e-be03-de0006b185bf tempest-TestStampPattern-1795639914 None] Terminate volume connection completed successfully. Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-e776b939-021c-4639-a137-bab74548d81b req-9182ba6d-5d20-4a1e-be03-de0006b185bf tempest-TestStampPattern-1795639914 None] Deleting attachment 9c5fc918-1196-406d-8f10-601e55f60c89. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (19237027-4f7a-4bde-b34b-f409f531b3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb402bc-8894-4ec0-b24b-193fc659480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb402bc-8894-4ec0-b24b-193fc659480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783272635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee85918-8802-4ffa-bbf5-e721dc291174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:41Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f7409b-8a7b-495f-8bae-998f7ef67cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f7409b-8a7b-495f-8bae-998f7ef67cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113546eb-bab4-4d1e-88db-f57ccb4e9f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113546eb-bab4-4d1e-88db-f57ccb4e9f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee85918-8802-4ffa-bbf5-e721dc291174', 'volume_name': 'volume-9ee85918-8802-4ffa-bbf5-e721dc291174', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2870d47-f03f-48bb-a26d-e9f66e864153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2870d47-f03f-48bb-a26d-e9f66e864153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9429f9a5-65cc-41ff-a969-607e6d37c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume 9ee85918-8802-4ffa-bbf5-e721dc291174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee85918-8802-4ffa-bbf5-e721dc291174', 'volume_size': 1} Sep 17 23:51:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:42 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:42 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:42 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.550s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:51:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:51:44 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img" returned: 0 in 9.563s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:44 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64ec21-4184-4779-a39b-8715d732017f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:44 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:51:44 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:44 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.574s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8, size 1024.00 MB, duration 9.56 sec, destination /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:51:45 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Converted 1024.00 MB image at 107.06 MB/s Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=57,cinder:SELECT=67,cinder:INSERT=15,cinder:DELETE=2 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=65,cinder:UPDATE=59,cinder:INSERT=10,cinder:DELETE=6 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] 72b8596b-6605-4360-9989-cb3ed56e59ab was raw, converting to qcow2 {{(pid=85956) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66bb061-9460-438f-925d-0170d53fdca0]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:45 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img Sep 17 23:51:45 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:45 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img" returned: 0 in 0.324s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:45 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img Sep 17 23:51:45 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:45 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img" returned: 1 in 0.329s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img /opt/stack/data/cinder/conversion/vol_upload_2kimjwsg {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:45 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img /opt/stack/data/cinder/conversion/vol_upload_2kimjwsg Sep 17 23:51:45 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-85f144be-25a8-440f-af90-6464c0caa653 tempest-GroupsV320Test-2062916230 None] Group tempest-GroupsV320Test-Group-1755287034: creating Sep 17 23:51:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-85f144be-25a8-440f-af90-6464c0caa653 tempest-GroupsV320Test-2062916230 None] Group tempest-GroupsV320Test-Group-1755287034: created successfully Sep 17 23:51:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-85f144be-25a8-440f-af90-6464c0caa653 tempest-GroupsV320Test-2062916230 None] Create group completed successfully. Sep 17 23:51:45 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img /opt/stack/data/cinder/conversion/vol_upload_2kimjwsg" returned: 0 in 0.255s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Image conversion details: src /opt/stack/data/cinder/conversion/0bf8aadd-3290-47cd-96d7-c95dbbb669b8.temp_image.72b8596b-6605-4360-9989-cb3ed56e59ab2r8mf_hl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2kimjwsg {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:51:45 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[985e231f-dd29-4727-b57d-16e972d0f95b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2kimjwsg {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:46 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2kimjwsg Sep 17 23:51:46 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:46 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2kimjwsg" returned: 0 in 0.344s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Created reservations ['492e7557-ac06-4471-9391-b312e25e1129'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:47 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:47 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.980s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Uploaded volume to glance image-id: 72b8596b-6605-4360-9989-cb3ed56e59ab. {{(pid=85956) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.810s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783272635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee85918-8802-4ffa-bbf5-e721dc291174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:41Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Creating volume 9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:51:47 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:47 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:47 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 1073741824 Sep 17 23:51:47 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:47 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b93901ad-69d2-4ab5-b07b-b1b486babaa4 tempest-VolumesActionsTest-1571028866 None] Copy volume to image completed successfully. Sep 17 23:51:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a113d6c3-306d-490c-860b-8c83a68db4f6 tempest-GroupsV320Test-2062916230 None] Delete group completed successfully. Sep 17 23:51:48 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 1073741824" returned: 0 in 0.452s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:48 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 Sep 17 23:51:48 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:48 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174" returned: 0 in 0.253s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.644s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Creating offline snapshot 45140563-6b5e-445f-8c28-0249990e4c10 of volume 953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9429f9a5-65cc-41ff-a969-607e6d37c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee85918-8802-4ffa-bbf5-e721dc291174', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699866fd-a30c-4daa-a94b-138cecb63a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac786a2-0f79-4e06-b707-756570fb8ba3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:48 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume volume-9ee85918-8802-4ffa-bbf5-e721dc291174 (9ee85918-8802-4ffa-bbf5-e721dc291174): created successfully Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699866fd-a30c-4daa-a94b-138cecb63a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (19237027-4f7a-4bde-b34b-f409f531b3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9a55a946-fced-4b77-9419-635b196b72b0 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created volume successfully. Sep 17 23:51:48 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 Sep 17 23:51:48 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:49 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" returned: 0 in 0.444s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:49 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 1G Sep 17 23:51:49 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "cinder-quobyte-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-quobyte-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bba70b-92bc-4ec9-bdaa-cb62c274ab5f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:49 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 1G" returned: 0 in 0.654s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:49 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 Sep 17 23:51:49 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:49 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:51:49 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:49 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10" returned: 0 in 0.340s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:50 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 is being set with open permissions: ugo+rw Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:50 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 Sep 17 23:51:50 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:50 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.437s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:50 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8 Sep 17 23:51:50 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:50 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10" returned: 0 in 0.297s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:50 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.info Sep 17 23:51:50 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:50 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" returned: 0 in 0.329s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-quobyte-0bf8aadd-3290-47cd-96d7-c95dbbb669b8" released by "delete_volume" :: held 0.817s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Created reservations ['88cd3eeb-0c91-466e-bb35-b2c4468e3188', 'dc95a25f-c8f2-4481-87fd-bd8c5f15d2a6', '22f9fe57-cfe7-48b2-a8d3-a0322b4c7037', '40febac1-a929-4f0b-94a7-1dfcfb6dc45a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:50 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:51:50 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:50 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.info" returned: 0 in 0.305s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:50 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.info is being set with open permissions: ugo+rw Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:50 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.info Sep 17 23:51:50 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:50 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.338s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:51:50 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Deleted volume successfully. Sep 17 23:51:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40f665c0-42f4-45e0-af60-e5c190653f76 tempest-VolumesActionsTest-1571028866 None] Lock "cinder-0bf8aadd-3290-47cd-96d7-c95dbbb669b8-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:51:51 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.info" returned: 0 in 0.362s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.618s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Creating offline snapshot e19d5428-4eff-4e34-a48d-305c09d8eefc of volume 9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:51:51 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e4550aff-624c-44a9-b1ae-224524c875a4 tempest-TestStampPattern-1795639914 None] Create snapshot completed successfully Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d4086f-efba-4dec-9790-6f58414a6cc4]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:51 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 Sep 17 23:51:51 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:51 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174" returned: 0 in 0.479s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:51 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc 1G Sep 17 23:51:51 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:52 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc 1G" returned: 0 in 0.643s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee85918-8802-4ffa-bbf5-e721dc291174 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:52 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee85918-8802-4ffa-bbf5-e721dc291174 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc Sep 17 23:51:52 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:52 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee85918-8802-4ffa-bbf5-e721dc291174 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc" returned: 0 in 0.481s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:52 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc is being set with open permissions: ugo+rw Sep 17 23:51:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:52 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc Sep 17 23:51:52 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:53 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc" returned: 0 in 0.317s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:53 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.info Sep 17 23:51:53 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:53 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.info" returned: 0 in 0.344s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:53 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.info is being set with open permissions: ugo+rw Sep 17 23:51:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:53 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.info Sep 17 23:51:53 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:53 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.info" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9a8cecd4-af9e-4c7e-82d3-cb380c17cb56 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Create snapshot completed successfully Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (963dc224-e328-4ce0-a3d7-c54a37a4d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadce4f-2f6d-434c-b17e-ea1e63deda9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadce4f-2f6d-434c-b17e-ea1e63deda9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-325723925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8dcf0e-0514-425d-8864-9d534c44e21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:55Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115b68b6-d2c1-438a-86ce-d6af1ee9a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115b68b6-d2c1-438a-86ce-d6af1ee9a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4047c1e6-2cd6-475b-91ca-60284a8412dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4047c1e6-2cd6-475b-91ca-60284a8412dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8dcf0e-0514-425d-8864-9d534c44e21f', 'volume_name': 'volume-6e8dcf0e-0514-425d-8864-9d534c44e21f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e45f088-b438-45a6-9031-1ed98c156a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e45f088-b438-45a6-9031-1ed98c156a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6367233c-77ce-482e-8669-8ce7339966da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:55 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume 6e8dcf0e-0514-425d-8864-9d534c44e21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8dcf0e-0514-425d-8864-9d534c44e21f', 'volume_size': 1} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-325723925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8dcf0e-0514-425d-8864-9d534c44e21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:55Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Creating volume 6e8dcf0e-0514-425d-8864-9d534c44e21f {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:51:55 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:55 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f 1073741824 Sep 17 23:51:55 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:55 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (e340a322-46d9-4cea-a980-5989b4354713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59de3cc5-1804-4dc4-b328-7644f650c820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59de3cc5-1804-4dc4-b328-7644f650c820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380537545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5007e16-3921-4559-beea-747c44c77963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:56Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6266c113-6bd9-4ea2-97e1-60bde4cc3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6266c113-6bd9-4ea2-97e1-60bde4cc3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d27bce9-534f-4a32-b53f-4b35e25dddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d27bce9-534f-4a32-b53f-4b35e25dddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5007e16-3921-4559-beea-747c44c77963', 'volume_name': 'volume-e5007e16-3921-4559-beea-747c44c77963', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b515999-83ac-4d11-8af3-daefb28aa32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b515999-83ac-4d11-8af3-daefb28aa32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd8a5ca-e244-4f38-bd91-11af9ec41e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:56 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume e5007e16-3921-4559-beea-747c44c77963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5007e16-3921-4559-beea-747c44c77963', 'volume_size': 1} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:56 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f 1073741824" returned: 0 in 0.894s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:56 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f Sep 17 23:51:56 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:56 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f" returned: 0 in 0.381s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380537545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5007e16-3921-4559-beea-747c44c77963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:56Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Creating volume e5007e16-3921-4559-beea-747c44c77963 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:51:56 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:51:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:57 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 1073741824 Sep 17 23:51:57 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6367233c-77ce-482e-8669-8ce7339966da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8dcf0e-0514-425d-8864-9d534c44e21f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84da3436-998c-420e-b62d-4bbdc47693a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume volume-6e8dcf0e-0514-425d-8864-9d534c44e21f (6e8dcf0e-0514-425d-8864-9d534c44e21f): created successfully Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84da3436-998c-420e-b62d-4bbdc47693a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (963dc224-e328-4ce0-a3d7-c54a37a4d87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (77ba3dc7-aa85-49b0-a094-d5a868e3a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bc1121-bdfe-499c-80c1-c618e2d58a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Flow 'volume_create_manager' (c0b7044c-478a-46cc-b22a-60fa8afe83d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5648139-c265-40c2-b74d-58f0efd36f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-71f52e43-0686-4db6-99a8-37eee40d70d2 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created volume successfully. Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bc1121-bdfe-499c-80c1-c618e2d58a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571921903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:57Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027a5a6f-d519-4488-8734-fbe25ca39c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027a5a6f-d519-4488-8734-fbe25ca39c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2494ee6e-60f1-4067-ac16-755f4fc9d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2494ee6e-60f1-4067-ac16-755f4fc9d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35', 'volume_name': 'volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06942da5-c18e-426c-94dc-d6c80bd7fc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06942da5-c18e-426c-94dc-d6c80bd7fc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c040b2-694b-49a3-9387-fe32fcb31830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume 4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35', 'volume_size': 1} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5648139-c265-40c2-b74d-58f0efd36f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1943360080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f40c95a-60be-4edc-a7cc-28207e025a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e9f69f9392492c8c23e48dc8c43b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:57Z,use_quota=True,user_id='eebfe2c4353c47b69035a648dcf7ae8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06ea4702-ba9d-44c1-b9cb-411ccba0fd0c),volume_type_id=06ea4702-ba9d-44c1-b9cb-411ccba0fd0c)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b4a880-849e-4208-b338-e390187a8b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b4a880-849e-4208-b338-e390187a8b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a6b74d-2ca7-4324-b27c-b8b7b66490f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a6b74d-2ca7-4324-b27c-b8b7b66490f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f40c95a-60be-4edc-a7cc-28207e025a37', 'volume_name': 'volume-9f40c95a-60be-4edc-a7cc-28207e025a37', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475f3465-013a-454b-a223-154ad1253f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475f3465-013a-454b-a223-154ad1253f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fe5dc8-89ce-4ac2-a6ec-33900c10ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Volume 9f40c95a-60be-4edc-a7cc-28207e025a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f40c95a-60be-4edc-a7cc-28207e025a37', 'volume_size': 1} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (a3e5c27a-da15-475c-9edd-18f5e9ba11b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b4a5ba-1462-4645-a20c-22d4ebd642fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b4a5ba-1462-4645-a20c-22d4ebd642fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143263492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317c5f7b-c5a6-4203-a45a-2556045c9a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:57Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e9522b-77ec-4f7b-997b-a3ed712f4d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e9522b-77ec-4f7b-997b-a3ed712f4d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30be8254-7102-40f0-9224-9ece9382a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30be8254-7102-40f0-9224-9ece9382a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317c5f7b-c5a6-4203-a45a-2556045c9a6b', 'volume_name': 'volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4f5d32-24d5-411e-bb49-079ad25eb4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4f5d32-24d5-411e-bb49-079ad25eb4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f033b2ff-5b25-494b-8e1a-ca04ca72fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume 317c5f7b-c5a6-4203-a45a-2556045c9a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b', 'volume_size': 1} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:51:57 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (c9f3f99d-2a42-4a53-ae85-a68edb57ab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0770744a-d3c4-4dbf-84bf-06476ed065ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 1073741824" returned: 0 in 0.861s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0770744a-d3c4-4dbf-84bf-06476ed065ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-639657000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed22bb2-8785-4083-b9e1-6c39370ce493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:58Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73238300-208a-4333-8245-00a93f06ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73238300-208a-4333-8245-00a93f06ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd53257-c03b-4b38-b213-3e61295dc000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd53257-c03b-4b38-b213-3e61295dc000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed22bb2-8785-4083-b9e1-6c39370ce493', 'volume_name': 'volume-eed22bb2-8785-4083-b9e1-6c39370ce493', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097a57ce-7adf-4f62-bd14-4fa2c9a9ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097a57ce-7adf-4f62-bd14-4fa2c9a9ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeef7d2c-eaee-431d-a961-b2c0f27463a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:57 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume eed22bb2-8785-4083-b9e1-6c39370ce493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed22bb2-8785-4083-b9e1-6c39370ce493', 'volume_size': 1} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:57 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 Sep 17 23:51:58 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:58 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963" returned: 0 in 0.276s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571921903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:57Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Creating volume 4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:51:58 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:58 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 1073741824 Sep 17 23:51:58 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd8a5ca-e244-4f38-bd91-11af9ec41e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5007e16-3921-4559-beea-747c44c77963', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cd000f-8a52-4d4d-9061-0e0349f66095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:58 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume volume-e5007e16-3921-4559-beea-747c44c77963 (e5007e16-3921-4559-beea-747c44c77963): created successfully Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cd000f-8a52-4d4d-9061-0e0349f66095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (e340a322-46d9-4cea-a980-5989b4354713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:58 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9338d460-5ee6-4e5e-8d09-61ec80da7a9e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created volume successfully. Sep 17 23:51:58 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 1073741824" returned: 0 in 0.601s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:58 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 Sep 17 23:51:58 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:59 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35" returned: 0 in 0.297s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1943360080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f40c95a-60be-4edc-a7cc-28207e025a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e9f69f9392492c8c23e48dc8c43b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:57Z,use_quota=True,user_id='eebfe2c4353c47b69035a648dcf7ae8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06ea4702-ba9d-44c1-b9cb-411ccba0fd0c),volume_type_id=06ea4702-ba9d-44c1-b9cb-411ccba0fd0c)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Creating volume 9f40c95a-60be-4edc-a7cc-28207e025a37 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:51:59 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c040b2-694b-49a3-9387-fe32fcb31830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30a1975-c7c2-4376-86e1-f444f9af8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:51:59 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 1073741824 Sep 17 23:51:59 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:51:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 (4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35): created successfully Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30a1975-c7c2-4376-86e1-f444f9af8d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (77ba3dc7-aa85-49b0-a094-d5a868e3a94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:51:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-29505569-78e3-41c4-aabc-6e33929689dc tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created volume successfully. Sep 17 23:51:59 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 1073741824" returned: 0 in 0.553s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:51:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:51:59 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 Sep 17 23:51:59 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:00 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37" returned: 0 in 0.287s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143263492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317c5f7b-c5a6-4203-a45a-2556045c9a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:57Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Creating volume 317c5f7b-c5a6-4203-a45a-2556045c9a6b {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:52:00 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fe5dc8-89ce-4ac2-a6ec-33900c10ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f40c95a-60be-4edc-a7cc-28207e025a37', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac401fad-e1cd-4cfc-879d-ab711b30ee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:00 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b 1073741824 Sep 17 23:52:00 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:00 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Volume volume-9f40c95a-60be-4edc-a7cc-28207e025a37 (9f40c95a-60be-4edc-a7cc-28207e025a37): created successfully Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac401fad-e1cd-4cfc-879d-ab711b30ee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Flow 'volume_create_manager' (c0b7044c-478a-46cc-b22a-60fa8afe83d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ae8345f4-f409-445c-864c-8a29a32236ea tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Created volume successfully. Sep 17 23:52:00 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b 1073741824" returned: 0 in 0.499s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:00 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b Sep 17 23:52:00 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:00 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:52:00 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Flow 'volume_create_manager' (56381af3-6c7d-458e-8005-b5d224fdcc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84543062-c8ec-4236-9f4d-8482c08eb224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b" returned: 0 in 0.360s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-639657000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed22bb2-8785-4083-b9e1-6c39370ce493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fda2b428fdb4418910e884e2f1073c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:51:58Z,use_quota=True,user_id='21adac92ae3a4e5db87e12e2b1ac4b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Creating volume eed22bb2-8785-4083-b9e1-6c39370ce493 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:52:01 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f033b2ff-5b25-494b-8e1a-ca04ca72fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:01 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 1073741824 Sep 17 23:52:01 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bad6fec-b82d-44dc-b610-06b9bf388607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84543062-c8ec-4236-9f4d-8482c08eb224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-231057708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2c1adc-6016-4e07-a76c-536d9cf94634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba67596a4ef143a1927652dcbdedd9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45140563-6b5e-445f-8c28-0249990e4c10,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:52:01Z,use_quota=True,user_id='b6124734949240a3a336fd6e23aa6d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f708257-9185-496d-8e3d-e50c9f25e98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f708257-9185-496d-8e3d-e50c9f25e98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f952307-79b7-446e-abe8-b5ac6935b3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f952307-79b7-446e-abe8-b5ac6935b3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c2c1adc-6016-4e07-a76c-536d9cf94634', 'volume_name': 'volume-8c2c1adc-6016-4e07-a76c-536d9cf94634', 'volume_size': 1, 'snapshot_id': '45140563-6b5e-445f-8c28-0249990e4c10'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cfd5d4-ee1a-4b25-824f-cf3ef83a0e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cfd5d4-ee1a-4b25-824f-cf3ef83a0e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0bdcd9-b365-4da2-88da-00dcde6fb158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Volume 8c2c1adc-6016-4e07-a76c-536d9cf94634: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c2c1adc-6016-4e07-a76c-536d9cf94634', 'volume_size': 1, 'snapshot_id': '45140563-6b5e-445f-8c28-0249990e4c10'} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b (317c5f7b-c5a6-4203-a45a-2556045c9a6b): created successfully Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bad6fec-b82d-44dc-b610-06b9bf388607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (a3e5c27a-da15-475c-9edd-18f5e9ba11b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b33fd18a-69cb-468f-b33d-3bbfdb191feb tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created volume successfully. Sep 17 23:52:01 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 1073741824" returned: 0 in 0.601s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:01 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 Sep 17 23:52:01 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:01 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:01 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:02 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493" returned: 0 in 0.315s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.884s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-quobyte-45140563-6b5e-445f-8c28-0249990e4c10-8c2c1adc-6016-4e07-a76c-536d9cf94634" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-45140563-6b5e-445f-8c28-0249990e4c10-8c2c1adc-6016-4e07-a76c-536d9cf94634" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Creating volume 8c2c1adc-6016-4e07-a76c-536d9cf94634 from snapshot 45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-quobyte-8c2c1adc-6016-4e07-a76c-536d9cf94634" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeef7d2c-eaee-431d-a961-b2c0f27463a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed22bb2-8785-4083-b9e1-6c39370ce493', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f0adeb-4578-49e3-89cb-4fb2cffd7233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:02 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Volume volume-eed22bb2-8785-4083-b9e1-6c39370ce493 (eed22bb2-8785-4083-b9e1-6c39370ce493): created successfully Sep 17 23:52:02 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f0adeb-4578-49e3-89cb-4fb2cffd7233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Flow 'volume_create_manager' (c9f3f99d-2a42-4a53-ae85-a68edb57ab4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-8c2c1adc-6016-4e07-a76c-536d9cf94634" acquired by "_copy_volume_from_snapshot" :: waited 0.099s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] snapshot: 45140563-6b5e-445f-8c28-0249990e4c10, volume: 8c2c1adc-6016-4e07-a76c-536d9cf94634, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.406s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a7048307-338f-41bf-8ef2-6fec12fceb70 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Retype volume completed successfully. Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-46e14c24-9e55-46fd-8dd4-0a67572fc857 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created volume successfully. Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c7d1ba-5846-4488-b81c-b3756d053452]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-eed22bb2-8785-4083-b9e1-6c39370ce493-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:02 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 Sep 17 23:52:02 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-eed22bb2-8785-4083-b9e1-6c39370ce493-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-eed22bb2-8785-4083-b9e1-6c39370ce493" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-eed22bb2-8785-4083-b9e1-6c39370ce493" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7bcb34-dc44-4755-ac5b-1a7eeb386f8b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:02 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 Sep 17 23:52:02 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:02 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10" returned: 0 in 0.612s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf2a9f-806f-4342-9445-3d5a50b2f44c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:03 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 Sep 17 23:52:03 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Acquiring lock "cinder-9f40c95a-60be-4edc-a7cc-28207e025a37-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "cinder-9f40c95a-60be-4edc-a7cc-28207e025a37-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Acquiring lock "cinder-quobyte-9f40c95a-60be-4edc-a7cc-28207e025a37" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "cinder-quobyte-9f40c95a-60be-4edc-a7cc-28207e025a37" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:03 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493" returned: 0 in 0.673s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c4c39e-6903-476c-a11b-a271f241da2d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:03 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493 Sep 17 23:52:03 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:03 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" returned: 0 in 0.562s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:52:03 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 Sep 17 23:52:03 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:03 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 Sep 17 23:52:03 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:03 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-eed22bb2-8785-4083-b9e1-6c39370ce493" returned: 0 in 0.451s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-eed22bb2-8785-4083-b9e1-6c39370ce493" released by "delete_volume" :: held 1.198s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created reservations ['3d702a72-c6b9-4087-bdf9-a35d18fc5fa6', '0b0e570b-9159-49bf-a383-eaf2f60c7a49', '78d07fcd-fcf1-4758-807e-b47673642e51', '7da0d127-2202-43ea-acad-05d24a7252cd'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:03 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37" returned: 0 in 0.684s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:03 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:03 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:03 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37 Sep 17 23:52:03 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:04 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9f40c95a-60be-4edc-a7cc-28207e025a37" returned: 0 in 0.333s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "cinder-quobyte-9f40c95a-60be-4edc-a7cc-28207e025a37" released by "delete_volume" :: held 1.103s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:04 devstack cinder-volume[85956]: WARNING cinder.quota [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:52:04 devstack cinder-volume[85956]: WARNING cinder.quota [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Created reservations ['26d55543-7185-4558-93b0-82cacb16a5a1', 'c8345ab1-a4e2-4da9-be00-8198a2502a77', '69589357-c017-4b91-a81a-2b263823d076', 'fbed4262-67c7-4c7e-a840-7dbdf2d66c9d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:04 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.631s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Deleted volume successfully. Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b63d3190-4598-47c7-8289-3313c9b9dc13 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-eed22bb2-8785-4083-b9e1-6c39370ce493-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:04 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:04 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-317c5f7b-c5a6-4203-a45a-2556045c9a6b-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-317c5f7b-c5a6-4203-a45a-2556045c9a6b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-317c5f7b-c5a6-4203-a45a-2556045c9a6b" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-317c5f7b-c5a6-4203-a45a-2556045c9a6b" acquired by "delete_volume" :: waited 0.043s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d9983f-0d73-4d93-812a-0e2de2632cc7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:05 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b Sep 17 23:52:05 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:05 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 1.111s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Deleted volume successfully. Sep 17 23:52:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8f2ef0c-6f16-465e-86e3-ab3292855972 tempest-VolumeRetypeWithoutMigrationTest-772022128 None] Lock "cinder-9f40c95a-60be-4edc-a7cc-28207e025a37-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:06 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b" returned: 0 in 1.284s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:06 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b Sep 17 23:52:06 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:07 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317c5f7b-c5a6-4203-a45a-2556045c9a6b" returned: 0 in 1.022s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-317c5f7b-c5a6-4203-a45a-2556045c9a6b" released by "delete_volume" :: held 2.500s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:07 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created reservations ['7df01c3a-6b2b-4bde-a4fb-15a7350e8c4b', 'a62e7f22-df74-4ca4-88e0-347aad40bc36', '3a14fe1d-dcd6-408e-9360-108ce43c13ec', 'e1fad963-fb36-494b-a7d1-55a589cd3535'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:08 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:08 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:08 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.716s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Deleted volume successfully. Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3cbf302e-aadc-49a4-8318-1a96a82fc02e tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-317c5f7b-c5a6-4203-a45a-2556045c9a6b-delete_volume" released by "delete_volume" :: held 3.935s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35" acquired by "delete_volume" :: waited 0.057s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:09 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[91862519-0e94-4166-b2f5-9cb901729b39]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:09 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 Sep 17 23:52:09 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:10 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35" returned: 0 in 1.108s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:10 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35 Sep 17 23:52:10 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:11 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35" returned: 0 in 0.661s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35" released by "delete_volume" :: held 1.898s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created reservations ['e4ecc564-00c1-44c0-b852-05a362c7b0da', 'd10669a4-99e7-4cf4-9cd1-63574a5cbe63', '7395e174-8365-4ad9-adde-897a577c2c82', 'cc694eb1-a078-4da6-9da6-09bd3285fba4'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:11 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:11 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-e5007e16-3921-4559-beea-747c44c77963-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-e5007e16-3921-4559-beea-747c44c77963-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-e5007e16-3921-4559-beea-747c44c77963" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-e5007e16-3921-4559-beea-747c44c77963" acquired by "delete_volume" :: waited 0.041s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5683fb0e-0770-4a89-8062-1fdcd3a60a3d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:12 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.712s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:12 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Deleted volume successfully. Sep 17 23:52:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3a48e3d7-12fb-45d5-882d-8fb50b292df6 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-4a4d39e1-6c4c-4fc6-88e8-416c54dc6f35-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:12 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 Sep 17 23:52:12 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:12 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963" returned: 0 in 0.993s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:12 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963 Sep 17 23:52:12 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:13 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e5007e16-3921-4559-beea-747c44c77963" returned: 0 in 0.429s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-e5007e16-3921-4559-beea-747c44c77963" released by "delete_volume" :: held 1.542s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created reservations ['626104c1-b8dc-4ca8-baf3-a06c9957275a', '16b983ba-b544-4b5d-a83d-c5e830994ec2', '07002b66-fde6-4e71-b48f-2695ef474a56', 'bb46c2fc-a186-4159-8ea1-4d236aaac16f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:13 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:13 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-6e8dcf0e-0514-425d-8864-9d534c44e21f-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:14 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-6e8dcf0e-0514-425d-8864-9d534c44e21f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.561s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Deleted volume successfully. Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-6e8dcf0e-0514-425d-8864-9d534c44e21f" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6186cdaa-41e0-415c-bf9c-259e5e3f6c81 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-e5007e16-3921-4559-beea-747c44c77963-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-6e8dcf0e-0514-425d-8864-9d534c44e21f" acquired by "delete_volume" :: waited 0.040s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462b682-0560-43ad-b59b-ddabd4fdd25a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:14 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f Sep 17 23:52:14 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:14 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f" returned: 0 in 0.513s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:14 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634" returned: 0 in 11.495s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4, size 1024.00 MB, duration 11.50 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:52:14 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Converted 1024.00 MB image at 89.07 MB/s Sep 17 23:52:14 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 is being set with open permissions: ugo+rw Sep 17 23:52:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:14 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f Sep 17 23:52:14 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:15 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 Sep 17 23:52:15 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:15 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6e8dcf0e-0514-425d-8864-9d534c44e21f" returned: 0 in 0.362s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-6e8dcf0e-0514-425d-8864-9d534c44e21f" released by "delete_volume" :: held 1.011s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:15 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634" returned: 0 in 0.432s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-8c2c1adc-6016-4e07-a76c-536d9cf94634" released by "_copy_volume_from_snapshot" :: held 13.267s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created reservations ['5c44aac1-7c5a-45d1-9b92-2f12b863a87c', '40a1aecf-a53a-443b-9c27-841b4171ca2b', '287c4b47-6448-4872-9c80-eb1cd249c115', '94638f7b-f5df-4f9e-8b18-f5a2f8551f2e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-45140563-6b5e-445f-8c28-0249990e4c10-8c2c1adc-6016-4e07-a76c-536d9cf94634" released by "_create_volume_from_snapshot" :: held 13.478s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.503s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0bdcd9-b365-4da2-88da-00dcde6fb158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2c1adc-6016-4e07-a76c-536d9cf94634', 'volume_size': 1, 'snapshot_id': '45140563-6b5e-445f-8c28-0249990e4c10'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd9cf14-f74e-4687-a46f-a8a2d5141d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:15 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Volume volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 (8c2c1adc-6016-4e07-a76c-536d9cf94634): created successfully Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd9cf14-f74e-4687-a46f-a8a2d5141d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Flow 'volume_create_manager' (56381af3-6c7d-458e-8005-b5d224fdcc76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e7fe6815-48cb-45bc-b01d-9575edbc6a54 tempest-TestStampPattern-1795639914 None] Created volume successfully. Sep 17 23:52:15 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:15 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:16 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.511s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Deleted volume successfully. Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-10fee8ea-5d53-4d63-b9e6-d9d3ce877d70 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-6e8dcf0e-0514-425d-8864-9d534c44e21f-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-e19d5428-4eff-4e34-a48d-305c09d8eefc-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-e19d5428-4eff-4e34-a48d-305c09d8eefc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-9ee85918-8802-4ffa-bbf5-e721dc291174" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-9ee85918-8802-4ffa-bbf5-e721dc291174" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-e19d5428-4eff-4e34-a48d-305c09d8eefc" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-e19d5428-4eff-4e34-a48d-305c09d8eefc" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Deleting offline snapshot e19d5428-4eff-4e34-a48d-305c09d8eefc of volume 9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] snapshot_file for this snap is: volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f62b54-71b5-4432-b27b-b3e542d8adff]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:16 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc Sep 17 23:52:16 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:17 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc" returned: 0 in 0.590s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ee85918-8802-4ffa-bbf5-e721dc291174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:52:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e567f2-8894-442e-8f2d-f288b2bace54]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:17 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 Sep 17 23:52:17 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:18 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174" returned: 0 in 0.731s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:18 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc Sep 17 23:52:18 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:18 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc" returned: 0 in 0.518s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:18 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc Sep 17 23:52:18 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:19 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174.e19d5428-4eff-4e34-a48d-305c09d8eefc" returned: 0 in 0.398s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-e19d5428-4eff-4e34-a48d-305c09d8eefc" released by "_delete_snapshot" :: held 2.534s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-9ee85918-8802-4ffa-bbf5-e721dc291174" released by "delete_snapshot" :: held 2.585s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:19 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created reservations ['9117a922-94f4-4b5c-9021-0310b8495343', '50d2ff6b-5c85-42e3-b48a-44c7f716c251', '68e51d22-2817-40de-af26-ac303b7a943f', '3e94b7b4-59fa-4365-b088-b66fe78a2e4c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Delete snapshot completed successfully. Sep 17 23:52:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a975ee8-4b26-4e6f-890b-9dd302517371 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-e19d5428-4eff-4e34-a48d-305c09d8eefc-delete_snapshot" released by "delete_snapshot" :: held 2.839s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-9ee85918-8802-4ffa-bbf5-e721dc291174-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-9ee85918-8802-4ffa-bbf5-e721dc291174-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "cinder-quobyte-9ee85918-8802-4ffa-bbf5-e721dc291174" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-9ee85918-8802-4ffa-bbf5-e721dc291174" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[10de4cdd-2f5e-43b2-a2e8-b6821a07e24c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:20 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 Sep 17 23:52:20 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:21 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174" returned: 0 in 0.680s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:21 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174 Sep 17 23:52:21 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:21 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ee85918-8802-4ffa-bbf5-e721dc291174" returned: 0 in 0.563s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-quobyte-9ee85918-8802-4ffa-bbf5-e721dc291174" released by "delete_volume" :: held 1.355s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Created reservations ['55aec216-9364-4594-8c1e-9af7e08182fd', 'aca9b59a-a061-471d-b438-2f7a9b563fbb', '21f5f133-7048-4e13-b73d-56c5da4969aa', '758a5c61-529c-4847-a60e-45f0a0f6b068'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:22 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:22 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:22 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.569s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:22 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Deleted volume successfully. Sep 17 23:52:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ba272d-45a0-437f-ba71-3698870aa073 tempest-CreateVolumesFromSnapshotTest-1222604276 None] Lock "cinder-9ee85918-8802-4ffa-bbf5-e721dc291174-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Flow 'volume_create_manager' (39911f76-a4ac-49b5-827b-b820e7f6af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7d7880-49e8-4fa1-a781-7259c931bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7d7880-49e8-4fa1-a781-7259c931bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-419788812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de23c1a-5d07-483d-95ce-71b6751d7570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a402510069514c85a951fe7365cd3804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:52:23Z,use_quota=True,user_id='77b8b7ec092c4d13a3b2bb4d50747fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0980299-6b2c-4279-9892-95d96efdb404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0980299-6b2c-4279-9892-95d96efdb404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6376e055-502b-4587-86cd-b3a3672b8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6376e055-502b-4587-86cd-b3a3672b8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de23c1a-5d07-483d-95ce-71b6751d7570', 'volume_name': 'volume-0de23c1a-5d07-483d-95ce-71b6751d7570', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42254f54-1ac7-4122-b5af-21ca7db60db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42254f54-1ac7-4122-b5af-21ca7db60db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834565bf-2532-467c-a754-0c5938787ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:23 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Volume 0de23c1a-5d07-483d-95ce-71b6751d7570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de23c1a-5d07-483d-95ce-71b6751d7570', 'volume_size': 1} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-419788812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de23c1a-5d07-483d-95ce-71b6751d7570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a402510069514c85a951fe7365cd3804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:52:23Z,use_quota=True,user_id='77b8b7ec092c4d13a3b2bb4d50747fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Creating volume 0de23c1a-5d07-483d-95ce-71b6751d7570 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:52:23 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:52:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:23 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 1073741824 Sep 17 23:52:23 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:24 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 1073741824" returned: 0 in 0.595s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:24 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 Sep 17 23:52:24 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:24 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570" returned: 0 in 0.457s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834565bf-2532-467c-a754-0c5938787ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de23c1a-5d07-483d-95ce-71b6751d7570', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ebca1-8b66-49a8-a2fc-fb161c61ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Volume volume-0de23c1a-5d07-483d-95ce-71b6751d7570 (0de23c1a-5d07-483d-95ce-71b6751d7570): created successfully Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ebca1-8b66-49a8-a2fc-fb161c61ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Flow 'volume_create_manager' (39911f76-a4ac-49b5-827b-b820e7f6af90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7b008f41-5c42-4a87-89f6-9884386bba9d tempest-VolumesServicesTestJSON-993985012 None] Created volume successfully. Sep 17 23:52:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Acquiring lock "cinder-0de23c1a-5d07-483d-95ce-71b6751d7570-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Lock "cinder-0de23c1a-5d07-483d-95ce-71b6751d7570-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Acquiring lock "cinder-quobyte-0de23c1a-5d07-483d-95ce-71b6751d7570" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Lock "cinder-quobyte-0de23c1a-5d07-483d-95ce-71b6751d7570" acquired by "delete_volume" :: waited 0.093s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf1121b-4d4c-480e-9bc9-879fdc2bce33]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:26 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 Sep 17 23:52:26 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:27 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570" returned: 0 in 0.796s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:27 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570 Sep 17 23:52:27 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:27 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0de23c1a-5d07-483d-95ce-71b6751d7570" returned: 0 in 0.589s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Lock "cinder-quobyte-0de23c1a-5d07-483d-95ce-71b6751d7570" released by "delete_volume" :: held 1.470s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Created reservations ['d68b97a3-8de9-4452-9536-baf71881269d', '492290a1-9413-48e4-9753-b0af407df65e', 'e0aeab31-a08c-413d-9c26-8b8d863d0f0e', '566e5ede-e723-49ba-92c2-492e20e2c366'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:27 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:27 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:28 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.337s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:28 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Deleted volume successfully. Sep 17 23:52:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3abc995d-617e-430f-9e02-e560ea69272c tempest-VolumesServicesTestJSON-993985012 None] Lock "cinder-0de23c1a-5d07-483d-95ce-71b6751d7570-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:37 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=98,cinder:UPDATE=123,cinder:INSERT=27,cinder:DELETE=9 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:52:38 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=82,cinder:UPDATE=108,cinder:INSERT=25,cinder:DELETE=11 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:42 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:42 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:42 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.368s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:52:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:52:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6dedf58a-c06f-4712-b0fd-da40bd4d3df1 req-bb7c9b48-b6f5-4d51-aa62-e8f57a8c1d67 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6dedf58a-c06f-4712-b0fd-da40bd4d3df1 req-bb7c9b48-b6f5-4d51-aa62-e8f57a8c1d67 tempest-TestStampPattern-1795639914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-6dedf58a-c06f-4712-b0fd-da40bd4d3df1 req-bb7c9b48-b6f5-4d51-aa62-e8f57a8c1d67 tempest-TestStampPattern-1795639914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-6dedf58a-c06f-4712-b0fd-da40bd4d3df1 req-bb7c9b48-b6f5-4d51-aa62-e8f57a8c1d67 tempest-TestStampPattern-1795639914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-8c2c1adc-6016-4e07-a76c-536d9cf94634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ed0ddc5-8c5e-4241-961a-757a137f8105', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:52:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-6dedf58a-c06f-4712-b0fd-da40bd4d3df1 req-bb7c9b48-b6f5-4d51-aa62-e8f57a8c1d67 tempest-TestStampPattern-1795639914 None] attachment_update completed successfully. Sep 17 23:52:52 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-3d429a6f-e207-45b5-b74c-1cc75bb96999 req-a61e4074-4705-4d9a-8688-e57bc0d7b693 tempest-TestStampPattern-1795639914 None] Terminate volume connection completed successfully. Sep 17 23:52:52 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-3d429a6f-e207-45b5-b74c-1cc75bb96999 req-a61e4074-4705-4d9a-8688-e57bc0d7b693 tempest-TestStampPattern-1795639914 None] Deleting attachment 4ed0ddc5-8c5e-4241-961a-757a137f8105. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Flow 'volume_create_manager' (e4fb4b06-1a55-4b02-8a88-3b9dea518cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baa4de0-0f6d-4aad-be6b-ae6c93a058df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baa4de0-0f6d-4aad-be6b-ae6c93a058df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1552955877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fb18a5-87bc-4788-933f-3c8aeb7c649c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fd9b36173f492785c9dbabb18c58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:52:53Z,use_quota=True,user_id='263d0996110d4446b5e595756409969b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc3bf94-eada-4069-892a-791e693c51da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc3bf94-eada-4069-892a-791e693c51da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0e5717-c21d-4c45-a05b-c6a49bc188a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0e5717-c21d-4c45-a05b-c6a49bc188a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fb18a5-87bc-4788-933f-3c8aeb7c649c', 'volume_name': 'volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55725533-7926-4ee5-a96a-ae31f244dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55725533-7926-4ee5-a96a-ae31f244dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb418f0-dc90-4172-a561-4c716041bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:53 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Volume 10fb18a5-87bc-4788-933f-3c8aeb7c649c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c', 'volume_size': 1} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1552955877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fb18a5-87bc-4788-933f-3c8aeb7c649c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fd9b36173f492785c9dbabb18c58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:52:53Z,use_quota=True,user_id='263d0996110d4446b5e595756409969b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Creating volume 10fb18a5-87bc-4788-933f-3c8aeb7c649c {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:52:53 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:52:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:53 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c 1073741824 Sep 17 23:52:53 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:54 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c 1073741824" returned: 0 in 0.804s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:54 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c Sep 17 23:52:54 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:54 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c" returned: 0 in 0.450s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:52:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb418f0-dc90-4172-a561-4c716041bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad475ca5-7347-4d15-864c-734054f735b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:52:55 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Volume volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c (10fb18a5-87bc-4788-933f-3c8aeb7c649c): created successfully Sep 17 23:52:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad475ca5-7347-4d15-864c-734054f735b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:52:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Flow 'volume_create_manager' (e4fb4b06-1a55-4b02-8a88-3b9dea518cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:52:55 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-73ffbf04-de0e-4a89-8a8d-c3283c591541 tempest-TestMinimumBasicScenario-2050091658 None] Created volume successfully. Sep 17 23:52:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-36fc8d0b-650c-4a7d-9144-7d561d4bd567 req-ce03b89c-a4b6-4bbd-b3dd-d11ac80c360b tempest-TestMinimumBasicScenario-2050091658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-36fc8d0b-650c-4a7d-9144-7d561d4bd567 req-ce03b89c-a4b6-4bbd-b3dd-d11ac80c360b tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-36fc8d0b-650c-4a7d-9144-7d561d4bd567 req-ce03b89c-a4b6-4bbd-b3dd-d11ac80c360b tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-36fc8d0b-650c-4a7d-9144-7d561d4bd567 req-ce03b89c-a4b6-4bbd-b3dd-d11ac80c360b tempest-TestMinimumBasicScenario-2050091658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0950087a-18ed-40fe-8d13-ab0ae7d688a2', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:52:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-36fc8d0b-650c-4a7d-9144-7d561d4bd567 req-ce03b89c-a4b6-4bbd-b3dd-d11ac80c360b tempest-TestMinimumBasicScenario-2050091658 None] attachment_update completed successfully. Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-8c2c1adc-6016-4e07-a76c-536d9cf94634-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Lock "cinder-8c2c1adc-6016-4e07-a76c-536d9cf94634-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-quobyte-8c2c1adc-6016-4e07-a76c-536d9cf94634" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-8c2c1adc-6016-4e07-a76c-536d9cf94634" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d81fa9-e860-47b1-aa77-40cc62c12b3c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:58 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 Sep 17 23:52:58 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:58 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634" returned: 0 in 0.534s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:58 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634 Sep 17 23:52:58 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:59 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8c2c1adc-6016-4e07-a76c-536d9cf94634" returned: 0 in 0.311s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-8c2c1adc-6016-4e07-a76c-536d9cf94634" released by "delete_volume" :: held 0.910s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Created reservations ['b0edd9ab-224c-4973-aecd-32426c077284', '64ea9400-3202-40bc-bad6-361978a6f877', '860fff9c-6614-471a-94f0-4b24f5740bd3', '0f4ee651-6ef7-4e26-8128-110937f541d5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:52:59 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:52:59 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:52:59 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.470s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:52:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Deleted volume successfully. Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-45140563-6b5e-445f-8c28-0249990e4c10-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3455bea4-0828-4bcd-93a1-8af962c3c8c5 tempest-TestStampPattern-1795639914 None] Lock "cinder-8c2c1adc-6016-4e07-a76c-536d9cf94634-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Lock "cinder-45140563-6b5e-445f-8c28-0249990e4c10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-quobyte-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-quobyte-45140563-6b5e-445f-8c28-0249990e4c10" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-45140563-6b5e-445f-8c28-0249990e4c10" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Deleting offline snapshot 45140563-6b5e-445f-8c28-0249990e4c10 of volume 953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] snapshot_file for this snap is: volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0a7a56-2cde-463f-8487-f969b6aa6608]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:52:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:00 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 Sep 17 23:53:00 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:00 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10" returned: 0 in 0.479s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:53:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bf2183-75a4-4ba7-8ce0-2c493fabdfce]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:00 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 Sep 17 23:53:00 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:01 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" returned: 0 in 0.726s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:01 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 Sep 17 23:53:01 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:01 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10" returned: 0 in 0.483s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:01 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10 Sep 17 23:53:01 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:02 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4.45140563-6b5e-445f-8c28-0249990e4c10" returned: 0 in 0.346s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-45140563-6b5e-445f-8c28-0249990e4c10" released by "_delete_snapshot" :: held 2.203s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" released by "delete_snapshot" :: held 2.239s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:02 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Created reservations ['fa799c7e-c9aa-4801-9651-e03eb90dab43', '65011dd5-3095-4412-840c-d3a89e985207', '1cb5017e-d0d4-4790-9d8f-b950f9f2e304', '2f27bd86-0a56-4d97-ae2f-c70c034cc711'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Delete snapshot completed successfully. Sep 17 23:53:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ba149932-cc3b-4d19-a441-0936818d6253 tempest-TestStampPattern-1795639914 None] Lock "cinder-45140563-6b5e-445f-8c28-0249990e4c10-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Flow 'volume_create_manager' (1ed233fa-10c0-47ca-a010-a56af6724bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55ab83c-0243-4810-aad6-b59ff57eaeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55ab83c-0243-4810-aad6-b59ff57eaeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2036503660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f3ceb-272f-447f-9fa0-bd62f94e510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce3bc4ffb13425ca6d9f3a7c4beb9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:05Z,use_quota=True,user_id='9804c915710b4d5fa7399f2fd810f53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5260609-1306-48a9-826c-35ebcaa57d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5260609-1306-48a9-826c-35ebcaa57d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def4af42-ddd2-44e4-8631-9208875993d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def4af42-ddd2-44e4-8631-9208875993d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9f3ceb-272f-447f-9fa0-bd62f94e510f', 'volume_name': 'volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abca6c8a-2d6a-4c3c-a977-205c69d84f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abca6c8a-2d6a-4c3c-a977-205c69d84f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d7a948-f4f4-47d0-852c-44bda2c534d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:05 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Volume 7f9f3ceb-272f-447f-9fa0-bd62f94e510f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f', 'volume_size': 1} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2036503660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f3ceb-272f-447f-9fa0-bd62f94e510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce3bc4ffb13425ca6d9f3a7c4beb9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:05Z,use_quota=True,user_id='9804c915710b4d5fa7399f2fd810f53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Creating volume 7f9f3ceb-272f-447f-9fa0-bd62f94e510f {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:05 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:05 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f 1073741824 Sep 17 23:53:05 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:06 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f 1073741824" returned: 0 in 0.571s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:06 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f Sep 17 23:53:06 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:06 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f" returned: 0 in 0.492s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d7a948-f4f4-47d0-852c-44bda2c534d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ce1734-4262-4416-af67-5e65297fe55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:06 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Volume volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f (7f9f3ceb-272f-447f-9fa0-bd62f94e510f): created successfully Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ce1734-4262-4416-af67-5e65297fe55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Flow 'volume_create_manager' (1ed233fa-10c0-47ca-a010-a56af6724bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-38897be4-78a9-4277-be24-778a52a952a8 tempest-VolumesMetadataTest-836055704 None] Created volume successfully. Sep 17 23:53:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Lock "cinder-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Acquiring lock "cinder-quobyte-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cacfd23-11de-4be8-9268-f8484e74664e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:08 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 Sep 17 23:53:08 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:08 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" returned: 0 in 0.392s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Acquiring lock "cinder-7f9f3ceb-272f-447f-9fa0-bd62f94e510f-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:08 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4 Sep 17 23:53:08 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Lock "cinder-7f9f3ceb-272f-447f-9fa0-bd62f94e510f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Acquiring lock "cinder-quobyte-7f9f3ceb-272f-447f-9fa0-bd62f94e510f" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Lock "cinder-quobyte-7f9f3ceb-272f-447f-9fa0-bd62f94e510f" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7dafb2-43eb-4ff6-9888-e4b449b60d96]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:08 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f Sep 17 23:53:08 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:08 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" returned: 0 in 0.320s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Lock "cinder-quobyte-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4" released by "delete_volume" :: held 0.808s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Created reservations ['9608cbd4-9bc3-4fc1-8be2-825c4f5e4cf0', '31226efd-5a5c-401d-bf84-24b5df343f58', 'a80497b7-93b3-4f84-a463-2cf641050f0d', '038bb2d4-04c0-4c9d-a139-338ac98bda64'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:09 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:09 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:09 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f" returned: 0 in 0.439s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:09 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f Sep 17 23:53:09 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:09 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:09 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Deleted volume successfully. Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bc448252-7199-419a-9f9a-a9b6be1b22d2 tempest-TestStampPattern-1795639914 None] Lock "cinder-953ad3d5-ac2a-4748-bdc9-9ebb53eab1c4-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:09 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f9f3ceb-272f-447f-9fa0-bd62f94e510f" returned: 0 in 0.262s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Lock "cinder-quobyte-7f9f3ceb-272f-447f-9fa0-bd62f94e510f" released by "delete_volume" :: held 0.775s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Created reservations ['c1738f69-5824-403d-8520-297ef81a2e37', '1272865d-26c8-4738-891d-888d687e79c7', 'f5a1b4d5-cb5f-4344-8ecf-1c45ea97efe3', '144da998-b918-4b0e-9cca-247a262dd012'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:09 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:09 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:09 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.293s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:09 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Deleted volume successfully. Sep 17 23:53:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ea0cbb9b-d906-4782-8a2b-71c6743af0c8 tempest-VolumesMetadataTest-836055704 None] Lock "cinder-7f9f3ceb-272f-447f-9fa0-bd62f94e510f-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Flow 'volume_create_manager' (2b8be98e-2460-4607-aad9-7270309df861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71963fac-85b6-4667-b015-a0ef393d60eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71963fac-85b6-4667-b015-a0ef393d60eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-62861637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d896aa39-48a9-4a14-93cf-e6c91254ed83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86c1da5664c4b2eba8b12c744648c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:16Z,use_quota=True,user_id='552f1d65510d4c628f66f665d8966c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b0fcd4-9b96-4a2d-a401-a92887eed502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b0fcd4-9b96-4a2d-a401-a92887eed502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86920c6-bec1-4436-9c51-1130b0b438bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86920c6-bec1-4436-9c51-1130b0b438bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd896aa39-48a9-4a14-93cf-e6c91254ed83', 'volume_name': 'volume-d896aa39-48a9-4a14-93cf-e6c91254ed83', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c064fe-b64a-4666-855e-415eac083e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c064fe-b64a-4666-855e-415eac083e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a64606-d8ac-4ca9-b70f-74092aba757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:15 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Volume d896aa39-48a9-4a14-93cf-e6c91254ed83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d896aa39-48a9-4a14-93cf-e6c91254ed83', 'volume_size': 1} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-62861637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d896aa39-48a9-4a14-93cf-e6c91254ed83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86c1da5664c4b2eba8b12c744648c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:16Z,use_quota=True,user_id='552f1d65510d4c628f66f665d8966c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Creating volume d896aa39-48a9-4a14-93cf-e6c91254ed83 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:15 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:15 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 1073741824 Sep 17 23:53:15 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:16 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 1073741824" returned: 0 in 0.481s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:16 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 Sep 17 23:53:16 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:16 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83" returned: 0 in 0.284s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a64606-d8ac-4ca9-b70f-74092aba757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d896aa39-48a9-4a14-93cf-e6c91254ed83', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56342f79-da08-41b5-b861-4aeef661510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:16 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Volume volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 (d896aa39-48a9-4a14-93cf-e6c91254ed83): created successfully Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56342f79-da08-41b5-b861-4aeef661510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Flow 'volume_create_manager' (2b8be98e-2460-4607-aad9-7270309df861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9a2a89fe-eb8b-4a47-b3af-2e42e5a64323 tempest-VolumesTransfersTest-504545298 None] Created volume successfully. Sep 17 23:53:18 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b1d1c39e-b01c-417e-b49e-e0ed0d8e5b63 tempest-VolumesTransfersTest-962094958 None] Transfer volume completed successfully. Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Acquiring lock "cinder-d896aa39-48a9-4a14-93cf-e6c91254ed83-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-d896aa39-48a9-4a14-93cf-e6c91254ed83-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Acquiring lock "cinder-quobyte-d896aa39-48a9-4a14-93cf-e6c91254ed83" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-quobyte-d896aa39-48a9-4a14-93cf-e6c91254ed83" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[322b17bf-ea36-4faa-b31b-3750aa768df7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:19 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 Sep 17 23:53:19 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:19 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83" returned: 0 in 0.484s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:19 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83 Sep 17 23:53:19 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:20 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d896aa39-48a9-4a14-93cf-e6c91254ed83" returned: 0 in 0.410s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-quobyte-d896aa39-48a9-4a14-93cf-e6c91254ed83" released by "delete_volume" :: held 0.954s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Created reservations ['b3987088-ce30-4f5d-b301-479bf91173f9', '27907c36-2ec7-4f1c-88e0-3f7348d0e23e', 'f1c4df80-b7bc-482d-b275-7c58ce793dff', 'cdeb8421-0f5b-4d5c-b116-35b811dd1d36'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:20 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:20 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:20 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:20 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Deleted volume successfully. Sep 17 23:53:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-514a26c8-d02c-4150-b7e7-978b004646d5 tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-d896aa39-48a9-4a14-93cf-e6c91254ed83-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Flow 'volume_create_manager' (828a1022-63ce-4624-80e0-9b2a30ed0e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31407525-907c-4af2-8d5a-ec64ca7b626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31407525-907c-4af2-8d5a-ec64ca7b626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-777495594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee927c8-be2e-4fd5-b0a6-e022e19948f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86c1da5664c4b2eba8b12c744648c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:22Z,use_quota=True,user_id='552f1d65510d4c628f66f665d8966c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d38e17-f889-47c0-ad18-38a5457b0f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d38e17-f889-47c0-ad18-38a5457b0f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223bb2ab-cd50-4f79-869a-1953b9efd19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223bb2ab-cd50-4f79-869a-1953b9efd19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee927c8-be2e-4fd5-b0a6-e022e19948f3', 'volume_name': 'volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0555b0c7-d686-4e5f-9c20-44864a354866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0555b0c7-d686-4e5f-9c20-44864a354866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf081de2-ee93-48fb-86ae-bff492ac3a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Volume dee927c8-be2e-4fd5-b0a6-e022e19948f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3', 'volume_size': 1} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-777495594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee927c8-be2e-4fd5-b0a6-e022e19948f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86c1da5664c4b2eba8b12c744648c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:22Z,use_quota=True,user_id='552f1d65510d4c628f66f665d8966c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Creating volume dee927c8-be2e-4fd5-b0a6-e022e19948f3 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:22 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:22 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 1073741824 Sep 17 23:53:22 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:22 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 1073741824" returned: 0 in 0.518s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:22 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 Sep 17 23:53:22 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (b0106e09-417f-4db9-96e3-7fd88c622398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4cec64-0026-4d4b-9bb4-cec54166fe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4cec64-0026-4d4b-9bb4-cec54166fe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-531340097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65d154-bb82-44f2-b480-f4f0e54b976a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:23Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438777a6-6c0f-4314-8288-2c3ad984e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438777a6-6c0f-4314-8288-2c3ad984e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f808b4c-081f-421f-93a3-74c03b777c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f808b4c-081f-421f-93a3-74c03b777c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f65d154-bb82-44f2-b480-f4f0e54b976a', 'volume_name': 'volume-2f65d154-bb82-44f2-b480-f4f0e54b976a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb43340-19c8-4788-94e1-3f15b8c65016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb43340-19c8-4788-94e1-3f15b8c65016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53ae0bb-0c05-422c-9a2d-12226a57d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Volume 2f65d154-bb82-44f2-b480-f4f0e54b976a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f65d154-bb82-44f2-b480-f4f0e54b976a', 'volume_size': 1} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3" returned: 0 in 0.414s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-531340097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65d154-bb82-44f2-b480-f4f0e54b976a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:23Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Creating volume 2f65d154-bb82-44f2-b480-f4f0e54b976a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:23 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf081de2-ee93-48fb-86ae-bff492ac3a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbecc25-6286-47f5-a0d6-692e9d31a66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a 1073741824 Sep 17 23:53:23 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:23 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Volume volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 (dee927c8-be2e-4fd5-b0a6-e022e19948f3): created successfully Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbecc25-6286-47f5-a0d6-692e9d31a66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Flow 'volume_create_manager' (828a1022-63ce-4624-80e0-9b2a30ed0e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:23 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-da598d06-eb98-446f-a14b-2b033ac4ee18 tempest-VolumesTransfersTest-504545298 None] Created volume successfully. Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (943d91c3-c8f7-4dcd-b4ed-cc173fba4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37c8bd0-d2ce-43b1-b949-cdfbc4b1b83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37c8bd0-d2ce-43b1-b949-cdfbc4b1b83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154922373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f257749-6fb2-4342-8852-94b5aacc5aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:23Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73196c86-b566-4265-aaa4-2426f74ba388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73196c86-b566-4265-aaa4-2426f74ba388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de28d7df-56b5-4981-b0a3-b180c8b88771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de28d7df-56b5-4981-b0a3-b180c8b88771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f257749-6fb2-4342-8852-94b5aacc5aa4', 'volume_name': 'volume-6f257749-6fb2-4342-8852-94b5aacc5aa4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99ea480-e645-40cb-8961-4096b582e91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99ea480-e645-40cb-8961-4096b582e91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e91e12-a9b5-47aa-a9e6-23cc1059f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:23 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Volume 6f257749-6fb2-4342-8852-94b5aacc5aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f257749-6fb2-4342-8852-94b5aacc5aa4', 'volume_size': 1} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:23 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a 1073741824" returned: 0 in 0.584s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:23 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a Sep 17 23:53:23 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (7f4847d6-7594-49f1-a09e-1eb1c63c19c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cdd88d-4027-4007-8b8d-5edeafc5ea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cdd88d-4027-4007-8b8d-5edeafc5ea79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-993807146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fead674f-51a4-4d47-b0f9-12324c74fb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:24Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef25d99-b258-4a36-bd1b-8c119153ed68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef25d99-b258-4a36-bd1b-8c119153ed68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c1d0f5-51e2-46ff-984e-c052e0222479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c1d0f5-51e2-46ff-984e-c052e0222479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fead674f-51a4-4d47-b0f9-12324c74fb53', 'volume_name': 'volume-fead674f-51a4-4d47-b0f9-12324c74fb53', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161e79f3-3e69-4617-bed9-d4fb322f2d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161e79f3-3e69-4617-bed9-d4fb322f2d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46050c41-a9ed-496f-aa3d-a09624b3e744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Volume fead674f-51a4-4d47-b0f9-12324c74fb53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fead674f-51a4-4d47-b0f9-12324c74fb53', 'volume_size': 1} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a" returned: 0 in 0.528s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154922373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f257749-6fb2-4342-8852-94b5aacc5aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:23Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Creating volume 6f257749-6fb2-4342-8852-94b5aacc5aa4 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:24 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53ae0bb-0c05-422c-9a2d-12226a57d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f65d154-bb82-44f2-b480-f4f0e54b976a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a2d86b-cc2d-4d7c-ac43-70a5dc2cdc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 1073741824 Sep 17 23:53:24 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Volume volume-2f65d154-bb82-44f2-b480-f4f0e54b976a (2f65d154-bb82-44f2-b480-f4f0e54b976a): created successfully Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a2d86b-cc2d-4d7c-ac43-70a5dc2cdc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (b0106e09-417f-4db9-96e3-7fd88c622398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dedf4c27-4865-407c-909a-27cc5f17245e tempest-CreateVolumesFromImageTest-257973322 None] Created volume successfully. Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Acquiring lock "cinder-dee927c8-be2e-4fd5-b0a6-e022e19948f3-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (558a0b35-4d18-4afc-a80b-d9d30d313f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44257f0b-aaf2-470c-97db-963fe5051223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-dee927c8-be2e-4fd5-b0a6-e022e19948f3-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44257f0b-aaf2-470c-97db-963fe5051223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202721284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e4d9d0-a2a3-4906-abbe-174de1d5a3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:25Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c6a2c7-848a-403e-9d90-7427788a896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c6a2c7-848a-403e-9d90-7427788a896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caafd083-729c-40bd-9413-38bbf91cb263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caafd083-729c-40bd-9413-38bbf91cb263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e4d9d0-a2a3-4906-abbe-174de1d5a3a9', 'volume_name': 'volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3be8877-77ee-4855-84cc-0796836cd942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3be8877-77ee-4855-84cc-0796836cd942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30672f4-640b-40d9-a1b4-8f731f93eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Volume 69e4d9d0-a2a3-4906-abbe-174de1d5a3a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9', 'volume_size': 1} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Acquiring lock "cinder-quobyte-dee927c8-be2e-4fd5-b0a6-e022e19948f3" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-quobyte-dee927c8-be2e-4fd5-b0a6-e022e19948f3" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d85090f-28a4-4b74-b32c-6bff3da9a125]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:25 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 Sep 17 23:53:25 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (ffb2c3b1-d23a-4efb-b44b-a865557563cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186163bb-3c48-48c3-8202-b75bf0b64996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:25 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 1073741824" returned: 0 in 0.830s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186163bb-3c48-48c3-8202-b75bf0b64996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958878632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca755fc-9925-49f1-8464-2f0c08b8f1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:25Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838149c1-d46a-4cb4-b418-4e906498c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838149c1-d46a-4cb4-b418-4e906498c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a22f858-8c2b-45f3-9051-2afe0d5cbc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a22f858-8c2b-45f3-9051-2afe0d5cbc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca755fc-9925-49f1-8464-2f0c08b8f1bf', 'volume_name': 'volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8ea38b-8495-40f5-a2c7-0b6d7a188506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8ea38b-8495-40f5-a2c7-0b6d7a188506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2a4793-1b08-4a03-aa8a-aedb60a9d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:25 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Volume 9ca755fc-9925-49f1-8464-2f0c08b8f1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf', 'volume_size': 1} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:25 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 Sep 17 23:53:25 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:25 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3" returned: 0 in 0.518s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:25 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3 Sep 17 23:53:25 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:25 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4" returned: 0 in 0.253s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-993807146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fead674f-51a4-4d47-b0f9-12324c74fb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:24Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Creating volume fead674f-51a4-4d47-b0f9-12324c74fb53 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:25 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:25 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 1073741824 Sep 17 23:53:25 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e91e12-a9b5-47aa-a9e6-23cc1059f78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f257749-6fb2-4342-8852-94b5aacc5aa4', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8d71e7-72f3-408b-8531-4c5f62abcc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:25 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Volume volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 (6f257749-6fb2-4342-8852-94b5aacc5aa4): created successfully Sep 17 23:53:25 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8d71e7-72f3-408b-8531-4c5f62abcc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (943d91c3-c8f7-4dcd-b4ed-cc173fba4a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-dee927c8-be2e-4fd5-b0a6-e022e19948f3" returned: 0 in 0.271s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-quobyte-dee927c8-be2e-4fd5-b0a6-e022e19948f3" released by "delete_volume" :: held 0.845s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c440a76d-f911-4d27-8dc6-735ffe8c05a0 tempest-CreateVolumesFromImageTest-257973322 None] Created volume successfully. Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Created reservations ['e17e358d-bb2a-4983-8af8-b976031efee5', '65888615-a4cb-4422-9922-7e090e8b4700', '5787daa1-069f-4e54-80df-01b90eedc5c3', '7bea87ae-7140-4eb2-b665-81a7c1eab9f3'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:25 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:25 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:26 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 1073741824" returned: 0 in 0.456s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:26 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 Sep 17 23:53:26 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:26 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.273s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Deleted volume successfully. Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b279da14-1adf-4bc8-875c-d19ea6c3195c tempest-VolumesTransfersTest-1128774134 None] Lock "cinder-dee927c8-be2e-4fd5-b0a6-e022e19948f3-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:26 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53" returned: 0 in 0.271s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202721284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e4d9d0-a2a3-4906-abbe-174de1d5a3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:25Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Creating volume 69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:26 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46050c41-a9ed-496f-aa3d-a09624b3e744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fead674f-51a4-4d47-b0f9-12324c74fb53', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8c337d-529b-4761-99e6-6543320e9a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:26 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 1073741824 Sep 17 23:53:26 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:26 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Volume volume-fead674f-51a4-4d47-b0f9-12324c74fb53 (fead674f-51a4-4d47-b0f9-12324c74fb53): created successfully Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8c337d-529b-4761-99e6-6543320e9a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (7f4847d6-7594-49f1-a09e-1eb1c63c19c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9b54ce2f-bc1f-4675-9d56-a49161428454 tempest-CreateVolumesFromImageTest-257973322 None] Created volume successfully. Sep 17 23:53:26 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 1073741824" returned: 0 in 0.418s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:26 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 Sep 17 23:53:26 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:27 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9" returned: 0 in 0.267s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958878632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca755fc-9925-49f1-8464-2f0c08b8f1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d50b1138181440e8164ed81b7824a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:25Z,use_quota=True,user_id='0a9ae03a775646c29bf6078399ae9eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Creating volume 9ca755fc-9925-49f1-8464-2f0c08b8f1bf {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:27 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30672f4-640b-40d9-a1b4-8f731f93eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:27 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf 1073741824 Sep 17 23:53:27 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ce375f-fa56-4943-9608-6ebb3febd1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:27 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Volume volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 (69e4d9d0-a2a3-4906-abbe-174de1d5a3a9): created successfully Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ce375f-fa56-4943-9608-6ebb3febd1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (558a0b35-4d18-4afc-a80b-d9d30d313f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-699e887b-16d0-4fd3-a37e-857325cd349c tempest-CreateVolumesFromImageTest-257973322 None] Created volume successfully. Sep 17 23:53:27 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf 1073741824" returned: 0 in 0.540s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:27 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf Sep 17 23:53:27 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:28 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf" returned: 0 in 0.267s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2a4793-1b08-4a03-aa8a-aedb60a9d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a07a2ae-b4ad-4566-8bed-02bde2180cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:28 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Volume volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf (9ca755fc-9925-49f1-8464-2f0c08b8f1bf): created successfully Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a07a2ae-b4ad-4566-8bed-02bde2180cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Flow 'volume_create_manager' (ffb2c3b1-d23a-4efb-b44b-a865557563cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-03b7a4df-4533-4078-a036-27c2aed14e8b tempest-CreateVolumesFromImageTest-257973322 None] Created volume successfully. Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-9ca755fc-9925-49f1-8464-2f0c08b8f1bf-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-9ca755fc-9925-49f1-8464-2f0c08b8f1bf-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-quobyte-9ca755fc-9925-49f1-8464-2f0c08b8f1bf" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-9ca755fc-9925-49f1-8464-2f0c08b8f1bf" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1665c4-dda1-4f4d-8b5b-92755a2928b6]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:28 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf Sep 17 23:53:28 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:29 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf" returned: 0 in 0.445s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:29 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf Sep 17 23:53:29 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:29 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9ca755fc-9925-49f1-8464-2f0c08b8f1bf" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-9ca755fc-9925-49f1-8464-2f0c08b8f1bf" released by "delete_volume" :: held 0.789s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Created reservations ['186d1d0d-6e74-4022-9c68-e1d53d0e61d1', '7c604c81-d2cb-470a-bb11-9381157226b4', '58942f45-517d-41d4-9e3f-a87f35a8c459', '739b55cb-f1f9-40e6-b36d-85e962aced8d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:29 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:29 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-quobyte-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:30 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb95b8b7-c0d7-4ad1-a098-be8414e420b9]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.353s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:30 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Deleted volume successfully. Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-badddce4-8aa3-4dc1-8927-59da666a2c8b tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-9ca755fc-9925-49f1-8464-2f0c08b8f1bf-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:30 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 Sep 17 23:53:30 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:30 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9" returned: 0 in 0.443s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:30 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9 Sep 17 23:53:30 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:30 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9" released by "delete_volume" :: held 0.773s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Created reservations ['9e363c11-ec00-453d-b7e0-90a895d5787b', '32c62b54-e83d-43a9-b44d-8a641f0df341', 'ee9a25e4-e52a-4b04-808e-c90a89bd2999', '793fcc9d-95cc-4b64-910c-d0e842a9a624'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:30 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:30 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-fead674f-51a4-4d47-b0f9-12324c74fb53-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-fead674f-51a4-4d47-b0f9-12324c74fb53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-quobyte-fead674f-51a4-4d47-b0f9-12324c74fb53" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-fead674f-51a4-4d47-b0f9-12324c74fb53" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46b0338-7a72-45e5-86b7-3ea6bde5d077]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:31 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.385s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Deleted volume successfully. Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b6a9236b-fe07-4c36-9c8c-8687abdcd3c7 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-69e4d9d0-a2a3-4906-abbe-174de1d5a3a9-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:31 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 Sep 17 23:53:31 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:31 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53" returned: 0 in 0.471s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:31 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53 Sep 17 23:53:31 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:32 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fead674f-51a4-4d47-b0f9-12324c74fb53" returned: 0 in 0.276s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-fead674f-51a4-4d47-b0f9-12324c74fb53" released by "delete_volume" :: held 0.809s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Created reservations ['75c9c375-32f6-461f-b8ab-6500377576ac', '2bda002e-2488-49b9-8c19-1c2f28da21ab', '307725bd-9f4f-4e08-a590-bdbc690feee3', 'e5d80058-f1bd-4359-8afb-844f5b40d92a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:32 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:32 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-6f257749-6fb2-4342-8852-94b5aacc5aa4-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-6f257749-6fb2-4342-8852-94b5aacc5aa4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-quobyte-6f257749-6fb2-4342-8852-94b5aacc5aa4" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:32 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.317s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Deleted volume successfully. Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-6f257749-6fb2-4342-8852-94b5aacc5aa4" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dfa84d2e-5f11-41f3-9263-49b946ed8d62 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-fead674f-51a4-4d47-b0f9-12324c74fb53-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f0975-6d86-4597-8264-d8f0d65bf584]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:32 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 Sep 17 23:53:32 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:33 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4" returned: 0 in 0.417s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:33 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4 Sep 17 23:53:33 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:33 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-6f257749-6fb2-4342-8852-94b5aacc5aa4" returned: 0 in 0.290s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-6f257749-6fb2-4342-8852-94b5aacc5aa4" released by "delete_volume" :: held 0.772s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Created reservations ['235f6649-28df-426b-80b2-5e2a9207bada', 'e0afd2c5-ead0-40d2-ae06-8c98013bbc29', 'd66a24ef-2f51-4371-a6b0-d2ba200fb48b', 'f3b3fb00-b992-4d29-9b61-83ae644933ff'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:33 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:33 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-2f65d154-bb82-44f2-b480-f4f0e54b976a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:33 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.290s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-2f65d154-bb82-44f2-b480-f4f0e54b976a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Deleted volume successfully. Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a19dff0-ba60-4104-84d6-ba3544aacd18 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-6f257749-6fb2-4342-8852-94b5aacc5aa4-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "cinder-quobyte-2f65d154-bb82-44f2-b480-f4f0e54b976a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-2f65d154-bb82-44f2-b480-f4f0e54b976a" acquired by "delete_volume" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d95e8a-9b54-490a-b1bb-1371bbf52da5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:33 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a Sep 17 23:53:33 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:34 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:34 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a Sep 17 23:53:34 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:34 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f65d154-bb82-44f2-b480-f4f0e54b976a" returned: 0 in 0.271s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-quobyte-2f65d154-bb82-44f2-b480-f4f0e54b976a" released by "delete_volume" :: held 0.706s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Created reservations ['d1fbcec3-6382-4719-bb94-1b50cdda2617', '0e6360e9-c066-4858-913d-ea7f3080d18b', 'ab9086de-a698-4071-ba47-c70fea2b99c3', 'dec2cf72-597e-460e-949f-d38086641004'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:34 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:34 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:34 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:34 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Deleted volume successfully. Sep 17 23:53:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-191730fa-78e1-43e1-ab5a-59977b700407 tempest-CreateVolumesFromImageTest-257973322 None] Lock "cinder-2f65d154-bb82-44f2-b480-f4f0e54b976a-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Flow 'volume_create_manager' (4d321b67-fde0-40be-9a24-12f627724c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b80007-dbf4-40c3-801f-76bb0f0fd7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b80007-dbf4-40c3-801f-76bb0f0fd7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1978602357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d8eeb6-1dec-457a-81f2-d06c08a8a23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101f8f54fdee4bd3ab6cb02408fc65fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:36Z,use_quota=True,user_id='431f5a0d868c4ab09b1197dbd61d51ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cdac1c-9496-4401-a5d2-1bc658622e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cdac1c-9496-4401-a5d2-1bc658622e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83284c23-d41b-4860-9e7a-81a0517c5bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83284c23-d41b-4860-9e7a-81a0517c5bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d8eeb6-1dec-457a-81f2-d06c08a8a23d', 'volume_name': 'volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594956d2-aa43-4c9f-9207-755efed48b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594956d2-aa43-4c9f-9207-755efed48b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46110829-e044-4195-8c40-1af93c5b98aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:35 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Volume 92d8eeb6-1dec-457a-81f2-d06c08a8a23d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d', 'volume_size': 1} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1978602357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d8eeb6-1dec-457a-81f2-d06c08a8a23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101f8f54fdee4bd3ab6cb02408fc65fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:36Z,use_quota=True,user_id='431f5a0d868c4ab09b1197dbd61d51ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Creating volume 92d8eeb6-1dec-457a-81f2-d06c08a8a23d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:35 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:35 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d 1073741824 Sep 17 23:53:35 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:36 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d 1073741824" returned: 0 in 0.456s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:36 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d Sep 17 23:53:36 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:36 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d" returned: 0 in 0.255s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46110829-e044-4195-8c40-1af93c5b98aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af7e194-08ac-41bf-bf5f-c867c4d4904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Volume volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d (92d8eeb6-1dec-457a-81f2-d06c08a8a23d): created successfully Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af7e194-08ac-41bf-bf5f-c867c4d4904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Flow 'volume_create_manager' (4d321b67-fde0-40be-9a24-12f627724c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d79b077d-5357-4d15-b19c-20314bb16a0c tempest-VolumesTransfersV355Test-269929884 None] Created volume successfully. Sep 17 23:53:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5c020ff5-6d37-4958-a714-87fa07b31cda tempest-VolumesTransfersV355Test-301424380 None] Transfer volume completed successfully. Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (8d77f618-21a2-4d89-bcc3-247f67afa551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051cefca-8dd2-495a-8d49-7718e8d2a302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051cefca-8dd2-495a-8d49-7718e8d2a302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1511202385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2011d957-59c1-4d64-8396-15b13a30d521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:38Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836112f9-f917-41d8-90c6-939fa07126f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836112f9-f917-41d8-90c6-939fa07126f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9627b16-747b-4a57-8b13-a32759704891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9627b16-747b-4a57-8b13-a32759704891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2011d957-59c1-4d64-8396-15b13a30d521', 'volume_name': 'volume-2011d957-59c1-4d64-8396-15b13a30d521', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214c2126-37c7-4821-ae15-7e5675dea621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214c2126-37c7-4821-ae15-7e5675dea621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d710378-824e-41a9-ba4b-2a00dbae2e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:37 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume 2011d957-59c1-4d64-8396-15b13a30d521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2011d957-59c1-4d64-8396-15b13a30d521', 'volume_size': 1} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1511202385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2011d957-59c1-4d64-8396-15b13a30d521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:38Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Creating volume 2011d957-59c1-4d64-8396-15b13a30d521 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:37 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:37 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 1073741824 Sep 17 23:53:37 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Acquiring lock "cinder-92d8eeb6-1dec-457a-81f2-d06c08a8a23d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:38 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 1073741824" returned: 0 in 0.441s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-92d8eeb6-1dec-457a-81f2-d06c08a8a23d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Acquiring lock "cinder-quobyte-92d8eeb6-1dec-457a-81f2-d06c08a8a23d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:38 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 Sep 17 23:53:38 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-quobyte-92d8eeb6-1dec-457a-81f2-d06c08a8a23d" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9641470-c8fc-4dcb-aa82-48df8be7aa7b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:38 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d Sep 17 23:53:38 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:38 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521" returned: 0 in 0.262s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d710378-824e-41a9-ba4b-2a00dbae2e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2011d957-59c1-4d64-8396-15b13a30d521', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b25d60-fb00-4c2d-8274-c0955e312b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:38 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume volume-2011d957-59c1-4d64-8396-15b13a30d521 (2011d957-59c1-4d64-8396-15b13a30d521): created successfully Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b25d60-fb00-4c2d-8274-c0955e312b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (8d77f618-21a2-4d89-bcc3-247f67afa551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1af91700-966e-4c30-81d4-6b0b7819f859 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created volume successfully. Sep 17 23:53:38 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d" returned: 0 in 0.411s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:38 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d Sep 17 23:53:38 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:39 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-92d8eeb6-1dec-457a-81f2-d06c08a8a23d" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-quobyte-92d8eeb6-1dec-457a-81f2-d06c08a8a23d" released by "delete_volume" :: held 0.727s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Created reservations ['2bd3694d-8916-4808-b0ad-402fe0541c4b', '00d10186-5c46-4c84-8991-151e1f25f74e', '939f2739-6e18-433f-b7bb-b3e5d27d7614', '1b1e6b9b-4840-43c7-aa46-70e00532681d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:39 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:39 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (5184345a-4295-4083-a340-350bc61f7908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f617df-0cd1-4456-8951-b7e12ac11bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f617df-0cd1-4456-8951-b7e12ac11bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-728846979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910f7ee1-a6f0-4057-821e-c5ec6c924d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:39Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03903b25-2cd2-4cf5-96f6-2d280bda5e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03903b25-2cd2-4cf5-96f6-2d280bda5e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150c04f8-9dff-4aa9-9f3b-b016d96e5a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150c04f8-9dff-4aa9-9f3b-b016d96e5a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910f7ee1-a6f0-4057-821e-c5ec6c924d34', 'volume_name': 'volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa61d902-c6b0-41b3-9fa9-5563e0f05ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa61d902-c6b0-41b3-9fa9-5563e0f05ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a5adff-8301-49f2-b5d6-ec7a7efca9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume 910f7ee1-a6f0-4057-821e-c5ec6c924d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34', 'volume_size': 1} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-728846979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910f7ee1-a6f0-4057-821e-c5ec6c924d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:39Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Creating volume 910f7ee1-a6f0-4057-821e-c5ec6c924d34 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:39 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:39 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 1073741824 Sep 17 23:53:39 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:39 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.358s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Deleted volume successfully. Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1e9ce46b-51cc-4424-be20-652f1c8fc13c tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-92d8eeb6-1dec-457a-81f2-d06c08a8a23d-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (0fe9a325-320e-4b80-aff7-7fff7de1b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecc493e-6881-481e-844e-7e7d751d1ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecc493e-6881-481e-844e-7e7d751d1ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122466182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22ad115-b93f-47d3-bc17-6d484682f264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:40Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b49108-3f47-43d7-bae3-d90f6d741214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b49108-3f47-43d7-bae3-d90f6d741214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbbd1f8-abe3-40d3-b231-21a84654a322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbbd1f8-abe3-40d3-b231-21a84654a322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22ad115-b93f-47d3-bc17-6d484682f264', 'volume_name': 'volume-c22ad115-b93f-47d3-bc17-6d484682f264', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee6541d-82a1-4a20-aa3f-d6f1dd0333d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee6541d-82a1-4a20-aa3f-d6f1dd0333d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5064f0-4b9a-4202-b139-fc03d734a0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume c22ad115-b93f-47d3-bc17-6d484682f264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22ad115-b93f-47d3-bc17-6d484682f264', 'volume_size': 1} Sep 17 23:53:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:40 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 1073741824" returned: 0 in 0.648s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:40 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 Sep 17 23:53:40 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Flow 'volume_create_manager' (f36fad9f-dceb-462c-bfd0-0fbd69a8e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944d1cda-655b-4bc9-987f-eb97d3ba8cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34" returned: 0 in 0.326s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122466182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22ad115-b93f-47d3-bc17-6d484682f264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:40Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Creating volume c22ad115-b93f-47d3-bc17-6d484682f264 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:40 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944d1cda-655b-4bc9-987f-eb97d3ba8cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-319808370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae374cb-84aa-4b5e-94ef-57403b773168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101f8f54fdee4bd3ab6cb02408fc65fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:40Z,use_quota=True,user_id='431f5a0d868c4ab09b1197dbd61d51ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71f2795-044b-4a45-b680-fba1e87b3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71f2795-044b-4a45-b680-fba1e87b3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba22c75-f136-4cbe-a10d-205095fcce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba22c75-f136-4cbe-a10d-205095fcce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae374cb-84aa-4b5e-94ef-57403b773168', 'volume_name': 'volume-fae374cb-84aa-4b5e-94ef-57403b773168', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a4eca6-22bf-49de-84af-70f35f18b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 1073741824 Sep 17 23:53:40 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a4eca6-22bf-49de-84af-70f35f18b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b704ef-c01a-401a-96c3-61084ca6d90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Volume fae374cb-84aa-4b5e-94ef-57403b773168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae374cb-84aa-4b5e-94ef-57403b773168', 'volume_size': 1} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (f70b7401-3c18-4366-b055-496dd73c1f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606a36b8-eb4a-41d9-8417-1a3ea8151396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a5adff-8301-49f2-b5d6-ec7a7efca9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfaf60d-6e39-4350-afe2-88effcbb3034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606a36b8-eb4a-41d9-8417-1a3ea8151396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26653058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96dfe0d-91ae-49d9-befb-31088e62ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:40Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39af3b56-ab60-44f3-9736-630689df830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39af3b56-ab60-44f3-9736-630689df830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720191c0-4f77-4a59-be5e-899f8d8c8b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720191c0-4f77-4a59-be5e-899f8d8c8b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96dfe0d-91ae-49d9-befb-31088e62ec3d', 'volume_name': 'volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e728dc39-1e0d-414c-9341-ad791017af89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e728dc39-1e0d-414c-9341-ad791017af89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6332ed90-8c96-4c35-b384-880eeb0253e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume a96dfe0d-91ae-49d9-befb-31088e62ec3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d', 'volume_size': 1} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 (910f7ee1-a6f0-4057-821e-c5ec6c924d34): created successfully Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfaf60d-6e39-4350-afe2-88effcbb3034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (5184345a-4295-4083-a340-350bc61f7908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (d21b5bc5-75bd-4b95-9f75-8822b9f4f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28352e2f-4842-4503-8e2f-bf5db3b39337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5c85a3c5-2364-40e3-b37b-2f53e3392fb3 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created volume successfully. Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28352e2f-4842-4503-8e2f-bf5db3b39337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1229232809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed3b667-6039-4719-bcbf-e36c1f0f27ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:41Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfde27a-7de2-4b41-9a4b-a6f8f454b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfde27a-7de2-4b41-9a4b-a6f8f454b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b840394-daa0-426a-8e87-47e0fadca8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b840394-daa0-426a-8e87-47e0fadca8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed3b667-6039-4719-bcbf-e36c1f0f27ee', 'volume_name': 'volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a133c96d-a5bb-4a02-ae3c-b9dbd69e5693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a133c96d-a5bb-4a02-ae3c-b9dbd69e5693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a602e5-8bc2-45e4-b631-833196ed7ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume 4ed3b667-6039-4719-bcbf-e36c1f0f27ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee', 'volume_size': 1} Sep 17 23:53:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (8ccca7cd-64a4-4517-ac76-92e6a69e1d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:41 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d35854-586e-42f6-b57e-b28eec3d7280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 1073741824" returned: 0 in 0.687s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d35854-586e-42f6-b57e-b28eec3d7280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269095315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e6123e-d9ed-45c7-b20b-f9136eb91908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:41Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c77b21-ab2e-427a-b50f-0182c91e482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c77b21-ab2e-427a-b50f-0182c91e482b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5d440e-edd7-4d52-b40a-835debaea7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5d440e-edd7-4d52-b40a-835debaea7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e6123e-d9ed-45c7-b20b-f9136eb91908', 'volume_name': 'volume-63e6123e-d9ed-45c7-b20b-f9136eb91908', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa6a59a-15cf-4cb7-b8a2-6d71cc64d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa6a59a-15cf-4cb7-b8a2-6d71cc64d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e45c4e0-50c0-4d38-b501-6dd3d6cdccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume 63e6123e-d9ed-45c7-b20b-f9136eb91908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e6123e-d9ed-45c7-b20b-f9136eb91908', 'volume_size': 1} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:41 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 Sep 17 23:53:41 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:41 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264" returned: 0 in 0.254s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-319808370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae374cb-84aa-4b5e-94ef-57403b773168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101f8f54fdee4bd3ab6cb02408fc65fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:40Z,use_quota=True,user_id='431f5a0d868c4ab09b1197dbd61d51ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Creating volume fae374cb-84aa-4b5e-94ef-57403b773168 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:41 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5064f0-4b9a-4202-b139-fc03d734a0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22ad115-b93f-47d3-bc17-6d484682f264', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:41 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 1073741824 Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf5fda4-679e-42b7-83df-aa9d0e7534a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:41 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume volume-c22ad115-b93f-47d3-bc17-6d484682f264 (c22ad115-b93f-47d3-bc17-6d484682f264): created successfully Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf5fda4-679e-42b7-83df-aa9d0e7534a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (0fe9a325-320e-4b80-aff7-7fff7de1b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a95dd471-7ca3-4949-b7e2-45112a907ee6 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created volume successfully. Sep 17 23:53:41 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 1073741824" returned: 0 in 0.473s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:41 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 Sep 17 23:53:42 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:42 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26653058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96dfe0d-91ae-49d9-befb-31088e62ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:40Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Creating volume a96dfe0d-91ae-49d9-befb-31088e62ec3d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:42 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:42 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:42 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b704ef-c01a-401a-96c3-61084ca6d90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae374cb-84aa-4b5e-94ef-57403b773168', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:42 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d 1073741824 Sep 17 23:53:42 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192ca268-9dae-46db-8416-77a077c291e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:42 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Volume volume-fae374cb-84aa-4b5e-94ef-57403b773168 (fae374cb-84aa-4b5e-94ef-57403b773168): created successfully Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192ca268-9dae-46db-8416-77a077c291e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Flow 'volume_create_manager' (f36fad9f-dceb-462c-bfd0-0fbd69a8e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-42b9bd72-2759-445d-9fbb-2186beff6ed9 tempest-VolumesTransfersV355Test-269929884 None] Created volume successfully. Sep 17 23:53:42 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.261s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:53:42 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d 1073741824" returned: 0 in 0.447s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:42 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d Sep 17 23:53:42 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:42 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1229232809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed3b667-6039-4719-bcbf-e36c1f0f27ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:41Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Creating volume 4ed3b667-6039-4719-bcbf-e36c1f0f27ee {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:43 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6332ed90-8c96-4c35-b384-880eeb0253e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:43 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee 1073741824 Sep 17 23:53:43 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4521848-52c9-4d93-8214-fcf41192c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:43 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d (a96dfe0d-91ae-49d9-befb-31088e62ec3d): created successfully Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4521848-52c9-4d93-8214-fcf41192c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (f70b7401-3c18-4366-b055-496dd73c1f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8762ef13-aa6e-41b5-ad9d-8485172e1fe7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created volume successfully. Sep 17 23:53:43 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee 1073741824" returned: 0 in 0.485s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:43 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee Sep 17 23:53:43 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Acquiring lock "cinder-fae374cb-84aa-4b5e-94ef-57403b773168-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-fae374cb-84aa-4b5e-94ef-57403b773168-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Acquiring lock "cinder-quobyte-fae374cb-84aa-4b5e-94ef-57403b773168" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-quobyte-fae374cb-84aa-4b5e-94ef-57403b773168" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ea86ce-6350-40fb-97a6-7ff55fde6b22]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:43 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee" returned: 0 in 0.298s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269095315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e6123e-d9ed-45c7-b20b-f9136eb91908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7210ddc792b547b9bf14e548576083e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:41Z,use_quota=True,user_id='15d50c54205a4ce4a7c2d86895af12f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Creating volume 63e6123e-d9ed-45c7-b20b-f9136eb91908 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:43 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:43 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 Sep 17 23:53:43 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a602e5-8bc2-45e4-b631-833196ed7ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf0787e-9301-4976-b716-009f07a466e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:43 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 1073741824 Sep 17 23:53:43 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:43 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee (4ed3b667-6039-4719-bcbf-e36c1f0f27ee): created successfully Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf0787e-9301-4976-b716-009f07a466e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (d21b5bc5-75bd-4b95-9f75-8822b9f4f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e6b5efa8-4b34-4470-a931-6cf42e7f0e8d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created volume successfully. Sep 17 23:53:44 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168" returned: 0 in 0.408s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:44 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168 Sep 17 23:53:44 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:44 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 1073741824" returned: 0 in 0.508s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:44 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 Sep 17 23:53:44 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:44 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-fae374cb-84aa-4b5e-94ef-57403b773168" returned: 0 in 0.322s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-quobyte-fae374cb-84aa-4b5e-94ef-57403b773168" released by "delete_volume" :: held 0.789s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Created reservations ['8111da64-d1cf-4e88-ad54-8f679f66e470', '5f7c4873-d04f-4c96-a216-01ada8324d99', '6a9d0c92-a72a-4d69-b4af-1d96afe61838', '5a742b87-6012-420e-9708-8d6695b44468'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:44 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908" returned: 0 in 0.316s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e45c4e0-50c0-4d38-b501-6dd3d6cdccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e6123e-d9ed-45c7-b20b-f9136eb91908', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:44 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:44 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30dc1dd-d96a-4006-85e7-1223631e18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:44 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Volume volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 (63e6123e-d9ed-45c7-b20b-f9136eb91908): created successfully Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30dc1dd-d96a-4006-85e7-1223631e18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Flow 'volume_create_manager' (8ccca7cd-64a4-4517-ac76-92e6a69e1d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-08a14ade-159f-4fc5-9062-1c27023ae573 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created volume successfully. Sep 17 23:53:45 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.323s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Deleted volume successfully. Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-3f908dd6-5774-4ee3-aaad-f1e7e5bc4860 tempest-VolumesTransfersV355Test-1103542322 None] Lock "cinder-fae374cb-84aa-4b5e-94ef-57403b773168-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-63e6123e-d9ed-45c7-b20b-f9136eb91908-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-63e6123e-d9ed-45c7-b20b-f9136eb91908-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-quobyte-63e6123e-d9ed-45c7-b20b-f9136eb91908" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-63e6123e-d9ed-45c7-b20b-f9136eb91908" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff7d95b-f244-48bf-a92e-e4b078e8aa23]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:45 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 Sep 17 23:53:45 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:46 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908" returned: 0 in 0.473s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:46 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908 Sep 17 23:53:46 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:46 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-63e6123e-d9ed-45c7-b20b-f9136eb91908" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-63e6123e-d9ed-45c7-b20b-f9136eb91908" released by "delete_volume" :: held 0.866s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created reservations ['29a65ff1-f8e8-4c71-bee0-6b10fede6b89', '95d8e24e-d623-4c1e-981c-9b976c20cd4c', '1509ad4d-6d07-41b3-8b14-91f1396da4e0', '21519ff7-ca88-482a-93c2-c8b5ff31b069'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:46 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:46 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-4ed3b667-6039-4719-bcbf-e36c1f0f27ee-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:46 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-5f64fd34-26b5-4238-9187-5bf0d9a71010 req-ee9650cb-747d-4e71-9fb8-f76646cdc802 tempest-TestMinimumBasicScenario-2050091658 None] Terminate volume connection completed successfully. Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-5f64fd34-26b5-4238-9187-5bf0d9a71010 req-ee9650cb-747d-4e71-9fb8-f76646cdc802 tempest-TestMinimumBasicScenario-2050091658 None] Deleting attachment 0950087a-18ed-40fe-8d13-ab0ae7d688a2. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-4ed3b667-6039-4719-bcbf-e36c1f0f27ee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-quobyte-4ed3b667-6039-4719-bcbf-e36c1f0f27ee" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-4ed3b667-6039-4719-bcbf-e36c1f0f27ee" acquired by "delete_volume" :: waited 0.042s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8df73a-e5e9-43ef-a155-91e1dd11bd13]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:47 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.341s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Deleted volume successfully. Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9acd94ad-d208-44d8-bce3-2ce2e653eb2d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-63e6123e-d9ed-45c7-b20b-f9136eb91908-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:47 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee Sep 17 23:53:47 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:47 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee" returned: 0 in 0.439s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:47 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee Sep 17 23:53:47 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Acquiring lock "cinder-10fb18a5-87bc-4788-933f-3c8aeb7c649c-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Lock "cinder-10fb18a5-87bc-4788-933f-3c8aeb7c649c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Acquiring lock "cinder-quobyte-10fb18a5-87bc-4788-933f-3c8aeb7c649c" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:47 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Lock "cinder-quobyte-10fb18a5-87bc-4788-933f-3c8aeb7c649c" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4ed3b667-6039-4719-bcbf-e36c1f0f27ee" returned: 0 in 0.315s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-4ed3b667-6039-4719-bcbf-e36c1f0f27ee" released by "delete_volume" :: held 0.812s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a982d7b-8a1b-481d-8d4f-3e88e15e475a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created reservations ['f11344fa-b0e0-44bb-a6ff-870c213b2561', '86690409-9b0a-4f48-98d1-5abbad6ef85b', '831720d1-be75-46cb-9ed9-5a1dc2d26fa8', 'f9fa5abb-6718-4dbc-b53c-17c7b76f8d0f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:47 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c Sep 17 23:53:47 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:48 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:48 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-a96dfe0d-91ae-49d9-befb-31088e62ec3d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-a96dfe0d-91ae-49d9-befb-31088e62ec3d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=127,cinder:UPDATE=174,cinder:INSERT=42,cinder:DELETE=14 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-quobyte-a96dfe0d-91ae-49d9-befb-31088e62ec3d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-a96dfe0d-91ae-49d9-befb-31088e62ec3d" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[69248832-654c-40e9-9a90-61ffb164a74a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:48 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c" returned: 0 in 0.485s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:48 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c Sep 17 23:53:48 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:48 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.368s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Deleted volume successfully. Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-cf0bbbda-59f3-41cd-8cc5-32a56ef52d4d tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-4ed3b667-6039-4719-bcbf-e36c1f0f27ee-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:48 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d Sep 17 23:53:48 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:48 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-10fb18a5-87bc-4788-933f-3c8aeb7c649c" returned: 0 in 0.341s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Lock "cinder-quobyte-10fb18a5-87bc-4788-933f-3c8aeb7c649c" released by "delete_volume" :: held 0.887s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=129,cinder:UPDATE=171,cinder:INSERT=35,cinder:DELETE=16 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Created reservations ['274bed39-7dd9-44fc-a5ec-44e2ac441534', '7fd4e209-948d-4500-b375-09deef1cb6cb', '7b23e32f-dd34-46e9-aa69-0a9802a18d5a', 'ca88ab1d-903c-447f-b1a8-a90980f8e8e6'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:48 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d" returned: 0 in 0.532s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:48 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d Sep 17 23:53:48 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:48 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:48 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:49 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.378s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:49 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Deleted volume successfully. Sep 17 23:53:49 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a96dfe0d-91ae-49d9-befb-31088e62ec3d" returned: 0 in 0.501s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-a96dfe0d-91ae-49d9-befb-31088e62ec3d" released by "delete_volume" :: held 1.094s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-92ff8b76-6b82-4188-84ac-b35cba678992 tempest-TestMinimumBasicScenario-2050091658 None] Lock "cinder-10fb18a5-87bc-4788-933f-3c8aeb7c649c-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created reservations ['77df9a8a-6c6f-4fda-939a-09b8764c3447', 'dd844cdf-f740-43fc-b778-477abd1f682d', '57b35ab9-81f4-43f3-b4b7-673476709d1c', 'ed530cc1-e494-4ca9-ad83-bf6074d233b7'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:49 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:49 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:49 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.433s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:49 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:49 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Deleted volume successfully. Sep 17 23:53:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2b8880c3-a7f5-4f50-bb49-607129df4a86 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-a96dfe0d-91ae-49d9-befb-31088e62ec3d-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-c22ad115-b93f-47d3-bc17-6d484682f264-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-c22ad115-b93f-47d3-bc17-6d484682f264-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-quobyte-c22ad115-b93f-47d3-bc17-6d484682f264" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-c22ad115-b93f-47d3-bc17-6d484682f264" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:50 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d15b431-dfbf-43d9-b32c-9270443abbc7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:50 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 Sep 17 23:53:50 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:51 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264" returned: 0 in 0.491s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:51 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264 Sep 17 23:53:51 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:51 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c22ad115-b93f-47d3-bc17-6d484682f264" returned: 0 in 0.309s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-c22ad115-b93f-47d3-bc17-6d484682f264" released by "delete_volume" :: held 0.868s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created reservations ['af37b1d2-5cdc-497d-af85-7b74bc65b826', 'cc97bdf8-b2c4-453b-b9c3-04e57a76e896', '7e65d179-c6d0-41c6-94a2-390c56d4e661', '6c0b3828-4399-4f07-ab48-43924178a95b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:51 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:51 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-910f7ee1-a6f0-4057-821e-c5ec6c924d34-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-910f7ee1-a6f0-4057-821e-c5ec6c924d34-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-quobyte-910f7ee1-a6f0-4057-821e-c5ec6c924d34" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-910f7ee1-a6f0-4057-821e-c5ec6c924d34" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2879df8e-cf41-4e98-a27e-390b6034eefd]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:51 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.379s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:51 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Deleted volume successfully. Sep 17 23:53:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-95eacbd5-546a-4a0e-a2d0-321a52c2adc7 tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-c22ad115-b93f-47d3-bc17-6d484682f264-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:51 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 Sep 17 23:53:51 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:52 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34" returned: 0 in 0.461s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:52 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34 Sep 17 23:53:52 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:52 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-910f7ee1-a6f0-4057-821e-c5ec6c924d34" returned: 0 in 0.300s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-910f7ee1-a6f0-4057-821e-c5ec6c924d34" released by "delete_volume" :: held 0.814s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created reservations ['43a98b3c-6d48-48f4-92a2-a240da1a136f', '19f97f30-93dc-4c4a-8ef9-b8fb06958afe', 'd1dcbcbc-94c5-4ff1-ad5b-0003ad308c43', 'baf30404-7e82-4bcc-a87d-24a51d96f57c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:52 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:52 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-2011d957-59c1-4d64-8396-15b13a30d521-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-2011d957-59c1-4d64-8396-15b13a30d521-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "cinder-quobyte-2011d957-59c1-4d64-8396-15b13a30d521" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-2011d957-59c1-4d64-8396-15b13a30d521" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c584d-2b02-4e28-9c13-36e281fb5999]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:53 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.310s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Deleted volume successfully. Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a95e61e0-8e57-4af2-9408-772a2de4739e tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-910f7ee1-a6f0-4057-821e-c5ec6c924d34-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:53 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 Sep 17 23:53:53 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Flow 'volume_create_manager' (a9f73e90-a519-4d07-b328-f98da41a4578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee8014a-ffd4-465a-87c3-ed8b08c745f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee8014a-ffd4-465a-87c3-ed8b08c745f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1936744886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ae5e38-f52e-40ae-be2e-752c228987c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965ad71a0d29459d9222bbe1b0ef90a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:53Z,use_quota=True,user_id='97c7f9dd07a04b749ecb5be1584bf8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a2a003-467e-4a3a-9de1-7245a57b2591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a2a003-467e-4a3a-9de1-7245a57b2591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0fb815-af7f-4017-99ec-fef62136f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:53 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0fb815-af7f-4017-99ec-fef62136f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ae5e38-f52e-40ae-be2e-752c228987c7', 'volume_name': 'volume-f2ae5e38-f52e-40ae-be2e-752c228987c7', 'volume_size': 2}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c69d082-ea88-421e-88fd-4d4d00bce57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c69d082-ea88-421e-88fd-4d4d00bce57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a50fda7-3dae-44cb-a7e8-37edf7be297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:53 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Volume f2ae5e38-f52e-40ae-be2e-752c228987c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ae5e38-f52e-40ae-be2e-752c228987c7', 'volume_size': 2} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1936744886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ae5e38-f52e-40ae-be2e-752c228987c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965ad71a0d29459d9222bbe1b0ef90a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:53:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:53:53Z,use_quota=True,user_id='97c7f9dd07a04b749ecb5be1584bf8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Creating volume f2ae5e38-f52e-40ae-be2e-752c228987c7 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:53:53 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 2147483648 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521" returned: 0 in 0.539s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:53 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 2147483648 Sep 17 23:53:53 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:53 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521 Sep 17 23:53:53 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:53 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2011d957-59c1-4d64-8396-15b13a30d521" returned: 0 in 0.265s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-quobyte-2011d957-59c1-4d64-8396-15b13a30d521" released by "delete_volume" :: held 0.867s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Created reservations ['da8d9283-f5d2-40d9-9899-1f87232d5cca', 'c724a843-dc4c-4a98-998d-ce1ba907acd4', '590bacfb-b667-4315-bae2-cb016ef307c3', 'ae7f7a0d-eae7-456c-bb98-f892c2438ce2'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:54 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:54 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:54 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 2147483648" returned: 0 in 0.640s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:54 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 Sep 17 23:53:54 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:54 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.326s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:54 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Deleted volume successfully. Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e1253808-8d14-4baf-9524-9c71bb5b2c1b tempest-CreateVolumesFromSourceVolumeTest-491533134 None] Lock "cinder-2011d957-59c1-4d64-8396-15b13a30d521-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:54 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7" returned: 0 in 0.315s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a50fda7-3dae-44cb-a7e8-37edf7be297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ae5e38-f52e-40ae-be2e-752c228987c7', 'volume_size': 2}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72052218-cbb7-489f-b8cc-c36fc5de7091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:53:54 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Volume volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 (f2ae5e38-f52e-40ae-be2e-752c228987c7): created successfully Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72052218-cbb7-489f-b8cc-c36fc5de7091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:53:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Flow 'volume_create_manager' (a9f73e90-a519-4d07-b328-f98da41a4578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:53:54 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f7ce19c7-6e0b-4ed3-a321-6a866bb7b654 tempest-VolumesCloneNegativeTest-1550312780 None] Created volume successfully. Sep 17 23:53:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Acquiring lock "cinder-f2ae5e38-f52e-40ae-be2e-752c228987c7-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Lock "cinder-f2ae5e38-f52e-40ae-be2e-752c228987c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Acquiring lock "cinder-quobyte-f2ae5e38-f52e-40ae-be2e-752c228987c7" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:53:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Lock "cinder-quobyte-f2ae5e38-f52e-40ae-be2e-752c228987c7" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:53:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c846f29-9a5a-49ac-b445-a5fa9351358c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:53:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:56 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 Sep 17 23:53:56 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:56 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7" returned: 0 in 0.484s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:56 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7 Sep 17 23:53:56 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:56 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-f2ae5e38-f52e-40ae-be2e-752c228987c7" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Lock "cinder-quobyte-f2ae5e38-f52e-40ae-be2e-752c228987c7" released by "delete_volume" :: held 0.824s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Created reservations ['5e576377-f2d5-4b0a-b51c-057dc7344f55', 'e7e12f11-49e4-4ec4-83fb-b406c9107bb9', '008c34b2-070c-489d-9b1a-2fc5822f85c0', 'b8f0237d-576a-4801-adf1-58e8b26adc30'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:53:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:53:56 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:53:56 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:53:57 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 17 23:53:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.343s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:53:57 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:53:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Deleted volume successfully. Sep 17 23:53:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27b52f58-1d13-447b-a2c0-1f648c17e9ac tempest-VolumesCloneNegativeTest-1550312780 None] Lock "cinder-f2ae5e38-f52e-40ae-be2e-752c228987c7-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (f5872917-2cf2-4a2b-b1d8-4c035588a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea14bfa-73ef-4220-a1c1-756764c90ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea14bfa-73ef-4220-a1c1-756764c90ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818038214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb03545-e51f-4f57-9b35-1260db561225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:06Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da53f07-cc3f-4abf-bf4b-de52292587fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da53f07-cc3f-4abf-bf4b-de52292587fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9e6130-6741-4563-8049-86f3b125c17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9e6130-6741-4563-8049-86f3b125c17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb03545-e51f-4f57-9b35-1260db561225', 'volume_name': 'volume-0bb03545-e51f-4f57-9b35-1260db561225', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90420f87-f642-415b-8d54-d721fbf6d0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90420f87-f642-415b-8d54-d721fbf6d0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74708d70-8342-4883-91e7-6bef7b00340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:06 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Volume 0bb03545-e51f-4f57-9b35-1260db561225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb03545-e51f-4f57-9b35-1260db561225', 'volume_size': 1} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818038214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb03545-e51f-4f57-9b35-1260db561225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:06Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Creating volume 0bb03545-e51f-4f57-9b35-1260db561225 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:06 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:06 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 1073741824 Sep 17 23:54:06 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:07 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 1073741824" returned: 0 in 0.535s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:07 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 Sep 17 23:54:07 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:07 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74708d70-8342-4883-91e7-6bef7b00340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb03545-e51f-4f57-9b35-1260db561225', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35523359-b49a-4019-8a8d-a22c225a5e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:07 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Volume volume-0bb03545-e51f-4f57-9b35-1260db561225 (0bb03545-e51f-4f57-9b35-1260db561225): created successfully Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35523359-b49a-4019-8a8d-a22c225a5e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:07 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (f5872917-2cf2-4a2b-b1d8-4c035588a472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:07 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ce7cb92a-7fc4-4d02-9f56-e94f49f5e320 tempest-ProjectReaderTests-493461068 None] Created volume successfully. Sep 17 23:54:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-0bb03545-e51f-4f57-9b35-1260db561225-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Lock "cinder-0bb03545-e51f-4f57-9b35-1260db561225-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-quobyte-0bb03545-e51f-4f57-9b35-1260db561225" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-0bb03545-e51f-4f57-9b35-1260db561225" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[912de4ee-eff6-4c78-bbd8-f20c08ece2d1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:09 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 Sep 17 23:54:09 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:09 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225" returned: 0 in 0.462s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:09 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225 Sep 17 23:54:09 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:09 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-0bb03545-e51f-4f57-9b35-1260db561225" returned: 0 in 0.355s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-0bb03545-e51f-4f57-9b35-1260db561225" released by "delete_volume" :: held 0.921s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:09 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Created reservations ['a3932ab7-b422-40db-bfdd-308f6ed35863', '018b162d-6cbf-4e88-9da0-a0780abed835', '1afde7a1-1406-4fa1-bda9-e12cd827f8e9', '2c9808ee-f5a8-4842-a2a9-cdcd38dd1a60'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:10 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:54:10 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:10 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:54:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Deleted volume successfully. Sep 17 23:54:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2ade6348-bcc7-4995-8e99-550fc73d8d51 tempest-ProjectReaderTests-493461068 None] Lock "cinder-0bb03545-e51f-4f57-9b35-1260db561225-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (d6e843c9-d1f7-4d06-a7c3-7a0579f16aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd134a2-005a-4e36-b158-de412de99c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd134a2-005a-4e36-b158-de412de99c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476804243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:12Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e671b8e7-76bf-4fdf-8df0-8051c8f73bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e671b8e7-76bf-4fdf-8df0-8051c8f73bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5789e2c5-aa03-4ed7-92c2-187b26110b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5789e2c5-aa03-4ed7-92c2-187b26110b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8', 'volume_name': 'volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8d9287-7d1c-4458-a67d-98ce8220297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8d9287-7d1c-4458-a67d-98ce8220297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f263d4f2-c7e0-4330-a258-c5e4c93d0a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Volume c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8', 'volume_size': 1} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476804243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:12Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Creating volume c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:11 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:11 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 1073741824 Sep 17 23:54:11 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:12 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 1073741824" returned: 0 in 0.521s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:12 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 Sep 17 23:54:12 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (623aa273-7e0d-4362-85a1-65b955cef932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d140562c-bb09-4c80-9e4f-7d32d3a4620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d140562c-bb09-4c80-9e4f-7d32d3a4620b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071066025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba39c201-31dc-45f0-82d1-05ec4cd0380c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:13Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fb7e71-9603-4859-996f-dccfa5764e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fb7e71-9603-4859-996f-dccfa5764e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84317204-dfd5-4a90-82d9-8f3ee6c4d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84317204-dfd5-4a90-82d9-8f3ee6c4d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba39c201-31dc-45f0-82d1-05ec4cd0380c', 'volume_name': 'volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:12 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5605f96-0664-43ce-a476-65733bfef348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5605f96-0664-43ce-a476-65733bfef348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6589b4-cef4-4821-a94c-37fac45d417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:12 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Volume ba39c201-31dc-45f0-82d1-05ec4cd0380c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c', 'volume_size': 1} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8" returned: 0 in 0.290s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071066025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba39c201-31dc-45f0-82d1-05ec4cd0380c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:13Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Creating volume ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:12 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:12 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c 1073741824 Sep 17 23:54:12 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f263d4f2-c7e0-4330-a258-c5e4c93d0a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36894191-705e-41d4-b843-9f1d52b74cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:12 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Volume volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 (c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8): created successfully Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36894191-705e-41d4-b843-9f1d52b74cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (d6e843c9-d1f7-4d06-a7c3-7a0579f16aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b1e870a2-654a-4a8a-952e-03d1f5291116 tempest-ProjectReaderTests-493461068 None] Created volume successfully. Sep 17 23:54:13 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c 1073741824" returned: 0 in 0.490s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:13 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c Sep 17 23:54:13 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:13 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c" returned: 0 in 0.261s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6589b4-cef4-4821-a94c-37fac45d417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f2088e-3abc-4492-8293-7245816568cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Volume volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c (ba39c201-31dc-45f0-82d1-05ec4cd0380c): created successfully Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f2088e-3abc-4492-8293-7245816568cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (623aa273-7e0d-4362-85a1-65b955cef932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:13 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-389a3cb0-70e9-44e5-96ff-d14c358ad95a tempest-VolumesSnapshotTestJSON-520789526 None] Created volume successfully. Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Lock "cinder-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-quobyte-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5881b8-99e6-427a-8add-776b44877412]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:14 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 Sep 17 23:54:14 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:14 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8" returned: 0 in 0.451s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:14 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8 Sep 17 23:54:14 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:14 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8" returned: 0 in 0.305s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8" released by "delete_volume" :: held 0.806s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Created reservations ['70889e59-67b6-48d6-9708-1a0b73076bc1', '0473c40d-69ad-401c-abe5-f10684657101', '9004d692-35db-47a0-a64d-69201eae1c88', 'f9dd74b1-609b-488a-b340-ac25ba980091'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:15 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:54:15 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Creating offline snapshot 421245b0-3798-409a-9d58-27a9beb22d73 of volume ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8881b30e-72c5-4914-8840-04cb0769b77e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:15 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c Sep 17 23:54:15 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:15 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.320s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:54:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Deleted volume successfully. Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a56c4cd-f8dd-47f9-8c0e-1a5977ed1688 tempest-ProjectReaderTests-493461068 None] Lock "cinder-c7a1ba9c-6956-4c3e-a620-5e1dcd58b3b8-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:15 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c" returned: 0 in 0.462s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:15 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 1G Sep 17 23:54:15 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (4797337b-d8a0-4633-b085-8480479cd2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4c0183-e99c-404a-b777-412db7b00a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4c0183-e99c-404a-b777-412db7b00a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91285742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eff9f30-b453-4124-8d65-ecc2448212ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:16Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9ad062-54c3-41b9-8fdd-9411a2a9fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9ad062-54c3-41b9-8fdd-9411a2a9fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a81e271-6134-460f-968f-c2332c2c4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a81e271-6134-460f-968f-c2332c2c4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eff9f30-b453-4124-8d65-ecc2448212ab', 'volume_name': 'volume-9eff9f30-b453-4124-8d65-ecc2448212ab', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e86f96-56ba-488d-8aee-dae1ec3da5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e86f96-56ba-488d-8aee-dae1ec3da5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0aebcf-8a9b-4a3a-be09-7f4b8cfdcb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:15 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Volume 9eff9f30-b453-4124-8d65-ecc2448212ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eff9f30-b453-4124-8d65-ecc2448212ab', 'volume_size': 1} Sep 17 23:54:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:16 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 1G" returned: 0 in 0.498s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:16 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 Sep 17 23:54:16 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:16 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73" returned: 0 in 0.318s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:16 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 is being set with open permissions: ugo+rw Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:16 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 Sep 17 23:54:16 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:16 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73" returned: 0 in 0.284s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:16 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.info Sep 17 23:54:16 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:16 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.info" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:16 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.info is being set with open permissions: ugo+rw Sep 17 23:54:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:17 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.info Sep 17 23:54:17 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:17 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.info" returned: 0 in 0.270s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91285742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eff9f30-b453-4124-8d65-ecc2448212ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:16Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Creating volume 9eff9f30-b453-4124-8d65-ecc2448212ab {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:17 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:17 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab 1073741824 Sep 17 23:54:17 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-766b6019-e030-46b9-9027-fc9934a67197 tempest-VolumesSnapshotTestJSON-520789526 None] Create snapshot completed successfully Sep 17 23:54:17 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab 1073741824" returned: 0 in 0.510s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:17 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab Sep 17 23:54:17 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:18 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab" returned: 0 in 0.252s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0aebcf-8a9b-4a3a-be09-7f4b8cfdcb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eff9f30-b453-4124-8d65-ecc2448212ab', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4469ce4-7d60-42d5-8e37-146234750f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:18 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Volume volume-9eff9f30-b453-4124-8d65-ecc2448212ab (9eff9f30-b453-4124-8d65-ecc2448212ab): created successfully Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4469ce4-7d60-42d5-8e37-146234750f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (4797337b-d8a0-4633-b085-8480479cd2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:18 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-45cc4e41-ab1f-4c39-878e-e33b2ec93837 tempest-ProjectReaderTests-493461068 None] Created volume successfully. Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-421245b0-3798-409a-9d58-27a9beb22d73-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-421245b0-3798-409a-9d58-27a9beb22d73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-ba39c201-31dc-45f0-82d1-05ec4cd0380c" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-ba39c201-31dc-45f0-82d1-05ec4cd0380c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-421245b0-3798-409a-9d58-27a9beb22d73" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-421245b0-3798-409a-9d58-27a9beb22d73" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Deleting offline snapshot 421245b0-3798-409a-9d58-27a9beb22d73 of volume ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] snapshot_file for this snap is: volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2573f8-2c1a-4758-ba8a-6a6649dc63bd]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:18 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 Sep 17 23:54:18 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:18 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73" returned: 0 in 0.492s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-9eff9f30-b453-4124-8d65-ecc2448212ab-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8879463-f88e-4d6d-ac83-286d33155c9e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Lock "cinder-9eff9f30-b453-4124-8d65-ecc2448212ab-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-quobyte-9eff9f30-b453-4124-8d65-ecc2448212ab" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-9eff9f30-b453-4124-8d65-ecc2448212ab" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:19 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c Sep 17 23:54:19 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d3cf74-2ef9-4228-b3ad-b3e6dc72c1ac]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:19 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab Sep 17 23:54:19 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:19 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c" returned: 0 in 0.524s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:19 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 Sep 17 23:54:19 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:19 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab" returned: 0 in 0.484s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:19 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab Sep 17 23:54:19 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:20 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9eff9f30-b453-4124-8d65-ecc2448212ab" returned: 0 in 0.346s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:20 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-9eff9f30-b453-4124-8d65-ecc2448212ab" released by "delete_volume" :: held 0.903s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73" returned: 0 in 0.528s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:20 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73 Sep 17 23:54:20 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Created reservations ['7fcda303-0d81-4081-939b-fab588f68c80', '355b97e2-f0d8-4638-acdf-220cf4f3fff6', '2566ee69-9d2f-4e42-a24a-8c7005ba6225', '370ac338-ef15-4460-827c-f33eb196b742'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:20 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:54:20 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:20 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c.421245b0-3798-409a-9d58-27a9beb22d73" returned: 0 in 0.297s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-421245b0-3798-409a-9d58-27a9beb22d73" released by "_delete_snapshot" :: held 2.012s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-ba39c201-31dc-45f0-82d1-05ec4cd0380c" released by "delete_snapshot" :: held 2.037s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['9ab57926-fd68-46a1-9fc4-e7388d7840d7', 'a69160f5-8044-44a9-92a6-a179dd817133', 'd562466f-22e1-4037-9fce-85368a0cde9e', 'a81732df-a951-499c-b94e-e8e6484184d6'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:20 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.272s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:54:20 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Delete snapshot completed successfully. Sep 17 23:54:20 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Deleted volume successfully. Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-63eb86d9-c21d-4ecb-be10-e476baa5444c tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-421245b0-3798-409a-9d58-27a9beb22d73-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d209552-8a10-4f19-9b5f-1d4543f24f59 tempest-ProjectReaderTests-493461068 None] Lock "cinder-9eff9f30-b453-4124-8d65-ecc2448212ab-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:21 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (19c24158-8b66-40f9-9dcb-aa0db789b048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccd8698-af0e-428c-bb61-daae136435f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccd8698-af0e-428c-bb61-daae136435f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216459731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e86e014-aefb-4090-8d99-9dafb4ed0080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:22Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e683200-51a8-4401-bdee-7c2d2ccbbede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e683200-51a8-4401-bdee-7c2d2ccbbede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90416ad7-72bf-44ae-9ab5-ffbf5191d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90416ad7-72bf-44ae-9ab5-ffbf5191d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e86e014-aefb-4090-8d99-9dafb4ed0080', 'volume_name': 'volume-1e86e014-aefb-4090-8d99-9dafb4ed0080', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dd1774-b7b0-489c-84d5-8c387cf8229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dd1774-b7b0-489c-84d5-8c387cf8229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3465794a-f762-40e0-94ab-281439ec4204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Volume 1e86e014-aefb-4090-8d99-9dafb4ed0080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e86e014-aefb-4090-8d99-9dafb4ed0080', 'volume_size': 1} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216459731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e86e014-aefb-4090-8d99-9dafb4ed0080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c50ddad5e9347ccb7e77fd63cd127cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:22Z,use_quota=True,user_id='deea6b9e1aeb426a80b42b10f4cb3caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Creating volume 1e86e014-aefb-4090-8d99-9dafb4ed0080 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:22 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:22 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 1073741824 Sep 17 23:54:22 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (deaba302-a0e0-4b65-9870-ef0df3650d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bf619f-d827-4fa4-9cf8-75d52d7f084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bf619f-d827-4fa4-9cf8-75d52d7f084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1648155997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5581a09-4531-41ce-a661-c21963e6cfe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:22Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787228e7-03c0-436d-ba08-5bd73b74af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787228e7-03c0-436d-ba08-5bd73b74af90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c33277-5a83-4fbd-8889-2e3c835f756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c33277-5a83-4fbd-8889-2e3c835f756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5581a09-4531-41ce-a661-c21963e6cfe5', 'volume_name': 'volume-c5581a09-4531-41ce-a661-c21963e6cfe5', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f878c1c6-ce7f-4cb0-94ae-705323a350c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f878c1c6-ce7f-4cb0-94ae-705323a350c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f5dcd0-659d-48ca-9d54-ba47c9dd89e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Volume c5581a09-4531-41ce-a661-c21963e6cfe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5581a09-4531-41ce-a661-c21963e6cfe5', 'volume_size': 1} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:22 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 1073741824" returned: 0 in 0.523s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:22 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 Sep 17 23:54:22 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:22 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080" returned: 0 in 0.256s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.555s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1648155997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5581a09-4531-41ce-a661-c21963e6cfe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:22Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Creating volume c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:22 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3465794a-f762-40e0-94ab-281439ec4204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e86e014-aefb-4090-8d99-9dafb4ed0080', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 1073741824 Sep 17 23:54:22 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faae0ebe-7dc6-4f0b-a496-efc5527f9083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Volume volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 (1e86e014-aefb-4090-8d99-9dafb4ed0080): created successfully Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faae0ebe-7dc6-4f0b-a496-efc5527f9083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Flow 'volume_create_manager' (19c24158-8b66-40f9-9dcb-aa0db789b048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a3d83acd-5eae-4f16-bc1c-1eccc11ba027 tempest-ProjectReaderTests-493461068 None] Created volume successfully. Sep 17 23:54:23 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 1073741824" returned: 0 in 0.461s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:23 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 Sep 17 23:54:23 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:23 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5" returned: 0 in 0.268s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f5dcd0-659d-48ca-9d54-ba47c9dd89e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5581a09-4531-41ce-a661-c21963e6cfe5', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98901311-4eab-4927-8f7b-9bbdd79b7f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:23 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Volume volume-c5581a09-4531-41ce-a661-c21963e6cfe5 (c5581a09-4531-41ce-a661-c21963e6cfe5): created successfully Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98901311-4eab-4927-8f7b-9bbdd79b7f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:23 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (deaba302-a0e0-4b65-9870-ef0df3650d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:23 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3faf7e66-1790-46e0-b7e5-cd1484733deb tempest-VolumesSnapshotTestJSON-520789526 None] Created volume successfully. Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-1e86e014-aefb-4090-8d99-9dafb4ed0080-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Lock "cinder-1e86e014-aefb-4090-8d99-9dafb4ed0080-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Acquiring lock "cinder-quobyte-1e86e014-aefb-4090-8d99-9dafb4ed0080" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-1e86e014-aefb-4090-8d99-9dafb4ed0080" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a34c2e-a319-4936-be2e-7296957567f5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:24 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 Sep 17 23:54:24 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Creating offline snapshot 86fe2668-e317-4e16-b51b-a6ea2e3b281d of volume c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:54:24 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080" returned: 0 in 0.466s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[357550f3-2139-4697-8bbf-6ed285c90e6c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:24 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080 Sep 17 23:54:24 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:24 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 Sep 17 23:54:24 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:24 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1e86e014-aefb-4090-8d99-9dafb4ed0080" returned: 0 in 0.292s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Lock "cinder-quobyte-1e86e014-aefb-4090-8d99-9dafb4ed0080" released by "delete_volume" :: held 0.813s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:24 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Created reservations ['e4ef724a-c26b-429b-a2e4-6f9d75f6d0de', '448ec142-d6cd-47d9-9c64-bc0b92714e1e', 'b102a774-490b-4100-954c-c7437fed5f65', '20667991-6f4c-4b4a-bc1d-28c1d11beb2d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:25 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5" returned: 0 in 0.441s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:25 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:54:25 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:25 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d 1G Sep 17 23:54:25 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:25 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:54:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Deleted volume successfully. Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ebd06a2f-65e2-4f59-8ad7-f3e24f430a32 tempest-ProjectReaderTests-493461068 None] Lock "cinder-1e86e014-aefb-4090-8d99-9dafb4ed0080-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:25 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d 1G" returned: 0 in 0.512s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5581a09-4531-41ce-a661-c21963e6cfe5 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:25 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5581a09-4531-41ce-a661-c21963e6cfe5 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d Sep 17 23:54:25 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:26 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5581a09-4531-41ce-a661-c21963e6cfe5 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d" returned: 0 in 0.526s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:26 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d is being set with open permissions: ugo+rw Sep 17 23:54:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:26 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d Sep 17 23:54:26 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:26 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d" returned: 0 in 0.327s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:26 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.info Sep 17 23:54:26 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:26 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.info" returned: 0 in 0.369s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:26 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.info is being set with open permissions: ugo+rw Sep 17 23:54:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:26 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.info Sep 17 23:54:26 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:27 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.info" returned: 0 in 0.273s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-16129598-6fb1-4bf4-a1d6-7891601aa76a tempest-VolumesSnapshotTestJSON-520789526 None] Create snapshot completed successfully Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (cb33703a-17a2-4e94-be53-b4989b96b965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a343b1a-9706-4e1d-aac1-58c922d4f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a343b1a-9706-4e1d-aac1-58c922d4f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1839587565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=86fe2668-e317-4e16-b51b-a6ea2e3b281d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:28Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22987b0d-53a6-4ebe-81c6-e5ae8c1429e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22987b0d-53a6-4ebe-81c6-e5ae8c1429e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8528c5dd-5a65-44e6-9606-632231fdb960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8528c5dd-5a65-44e6-9606-632231fdb960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45', 'volume_name': 'volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45', 'volume_size': 2, 'snapshot_id': '86fe2668-e317-4e16-b51b-a6ea2e3b281d'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df033a8b-77f8-4fde-95be-9220b0f63b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df033a8b-77f8-4fde-95be-9220b0f63b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c392a68-35cd-4fc3-8f08-ad50abf22fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:28 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Volume cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45', 'volume_size': 2, 'snapshot_id': '86fe2668-e317-4e16-b51b-a6ea2e3b281d'} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-86fe2668-e317-4e16-b51b-a6ea2e3b281d-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-86fe2668-e317-4e16-b51b-a6ea2e3b281d-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Creating volume cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 from snapshot 86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] snapshot: 86fe2668-e317-4e16-b51b-a6ea2e3b281d, volume: cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9044d957-da6b-4029-8a94-a438065f5fe4]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:28 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d Sep 17 23:54:28 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:29 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d" returned: 0 in 0.455s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5581a09-4531-41ce-a661-c21963e6cfe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb02802-b980-4b5c-9b79-a2d7de1f4ced]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:29 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 Sep 17 23:54:29 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:29 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5" returned: 0 in 0.527s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:54:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:29 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 Sep 17 23:54:29 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Flow 'volume_create_manager' (63d4fb73-bc93-45da-b71d-e5bfcd95dcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f403a7e-504f-44de-9810-33a67807db81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f403a7e-504f-44de-9810-33a67807db81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-699497922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa76b229-131f-479b-9428-ade83db07a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a1d124d8a4818a8c10f2a2cd53f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:31Z,use_quota=True,user_id='249aa2c0f12643d8a0a341375300399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8db6304-a113-4055-a01e-01be92e73e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8db6304-a113-4055-a01e-01be92e73e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97f4d5c-23e1-451b-9b84-cd6288e36fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97f4d5c-23e1-451b-9b84-cd6288e36fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa76b229-131f-479b-9428-ade83db07a9f', 'volume_name': 'volume-aa76b229-131f-479b-9428-ade83db07a9f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3b6ea8-d6a6-4b8f-ade4-597363173daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3b6ea8-d6a6-4b8f-ade4-597363173daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3585a15-c822-4258-a5d7-b38e9ca35230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:31 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Volume aa76b229-131f-479b-9428-ade83db07a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa76b229-131f-479b-9428-ade83db07a9f', 'volume_size': 1} Sep 17 23:54:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Flow 'volume_create_manager' (46cfcb3f-c147-4ff6-a050-a20aadf5cac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4bc16c-b866-4e07-9624-30e404bc63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4bc16c-b866-4e07-9624-30e404bc63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-385457648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe47860-fed5-4df7-8cab-bfb15a870da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a1d124d8a4818a8c10f2a2cd53f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:32Z,use_quota=True,user_id='249aa2c0f12643d8a0a341375300399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf88ad-e618-4a9d-bd19-b377dc1b0284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf88ad-e618-4a9d-bd19-b377dc1b0284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf0ffe5-b865-4936-aa9e-60406372e4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf0ffe5-b865-4936-aa9e-60406372e4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe47860-fed5-4df7-8cab-bfb15a870da8', 'volume_name': 'volume-efe47860-fed5-4df7-8cab-bfb15a870da8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d0dc7e-4f14-482a-8f8f-11c3331b01a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d0dc7e-4f14-482a-8f8f-11c3331b01a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e585d6b-bb46-4262-90c4-f8352715385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:32 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Volume efe47860-fed5-4df7-8cab-bfb15a870da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe47860-fed5-4df7-8cab-bfb15a870da8', 'volume_size': 1} Sep 17 23:54:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:38 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" returned: 0 in 8.353s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:54:38 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Converted 1024.00 MB image at 122.57 MB/s Sep 17 23:54:38 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 is being set with open permissions: ugo+rw Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:38 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 Sep 17 23:54:38 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:38 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" returned: 0 in 0.258s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" released by "_copy_volume_from_snapshot" :: held 9.772s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-86fe2668-e317-4e16-b51b-a6ea2e3b281d-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" released by "_create_volume_from_snapshot" :: held 9.879s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.902s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.911s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-699497922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa76b229-131f-479b-9428-ade83db07a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a1d124d8a4818a8c10f2a2cd53f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:31Z,use_quota=True,user_id='249aa2c0f12643d8a0a341375300399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Creating volume aa76b229-131f-479b-9428-ade83db07a9f {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:38 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:38 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f 1073741824 Sep 17 23:54:38 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c392a68-35cd-4fc3-8f08-ad50abf22fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45', 'volume_size': 2, 'snapshot_id': '86fe2668-e317-4e16-b51b-a6ea2e3b281d'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f97401-826d-4130-80a6-0129fd06acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:38 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Volume volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 (cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45): created successfully Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f97401-826d-4130-80a6-0129fd06acda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (cb33703a-17a2-4e94-be53-b4989b96b965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5ecf55fb-d95c-4955-84fd-6bab9d91b761 tempest-VolumesSnapshotTestJSON-520789526 None] Created volume successfully. Sep 17 23:54:39 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f 1073741824" returned: 0 in 0.583s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:39 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f Sep 17 23:54:39 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:39 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.064s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-385457648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe47860-fed5-4df7-8cab-bfb15a870da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a1d124d8a4818a8c10f2a2cd53f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:32Z,use_quota=True,user_id='249aa2c0f12643d8a0a341375300399f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Creating volume efe47860-fed5-4df7-8cab-bfb15a870da8 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:39 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3585a15-c822-4258-a5d7-b38e9ca35230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa76b229-131f-479b-9428-ade83db07a9f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:39 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 1073741824 Sep 17 23:54:39 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f072c536-9e98-4bf9-9561-b7410b156f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Volume volume-aa76b229-131f-479b-9428-ade83db07a9f (aa76b229-131f-479b-9428-ade83db07a9f): created successfully Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f072c536-9e98-4bf9-9561-b7410b156f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Flow 'volume_create_manager' (63d4fb73-bc93-45da-b71d-e5bfcd95dcb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" acquired by "delete_volume" :: waited 0.056s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b8e7af71-bbb2-4e8c-9b87-ae896b4435e3 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Created volume successfully. Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[839a60eb-7252-461e-906c-a4a65c1b7984]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:39 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 Sep 17 23:54:39 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:40 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 1073741824" returned: 0 in 0.584s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:40 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" returned: 0 in 0.520s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:40 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45 Sep 17 23:54:40 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:40 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 Sep 17 23:54:40 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:40 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8" returned: 0 in 0.429s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e585d6b-bb46-4262-90c4-f8352715385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe47860-fed5-4df7-8cab-bfb15a870da8', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9290e78d-18e1-4652-bfc9-62a0da7fa884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:40 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Volume volume-efe47860-fed5-4df7-8cab-bfb15a870da8 (efe47860-fed5-4df7-8cab-bfb15a870da8): created successfully Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9290e78d-18e1-4652-bfc9-62a0da7fa884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Flow 'volume_create_manager' (46cfcb3f-c147-4ff6-a050-a20aadf5cac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" returned: 0 in 0.523s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9d8dcfed-aec9-4a66-a0b5-4164a55042b5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Created volume successfully. Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45" released by "delete_volume" :: held 1.118s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['3e41ccd2-a935-4069-b439-c596be94b2cc', 'faef1ab7-b6f6-4389-8ca8-a81cf38c0042', 'e039f4c8-c47d-441d-a47a-20063579e588', 'b16f57b7-be29-47b1-b42e-8b6603900b30'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:40 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:54:40 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:41 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:54:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Deleted volume successfully. Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-60a78a55-d583-4ed6-aa27-78820091b6ec tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-cf8a5f99-75b8-4ed1-aa7f-270ba6b75d45-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-86fe2668-e317-4e16-b51b-a6ea2e3b281d-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-86fe2668-e317-4e16-b51b-a6ea2e3b281d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-c5581a09-4531-41ce-a661-c21963e6cfe5" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-c5581a09-4531-41ce-a661-c21963e6cfe5" acquired by "delete_snapshot" :: waited 0.044s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-86fe2668-e317-4e16-b51b-a6ea2e3b281d" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-86fe2668-e317-4e16-b51b-a6ea2e3b281d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Deleting offline snapshot 86fe2668-e317-4e16-b51b-a6ea2e3b281d of volume c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] snapshot_file for this snap is: volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[50668dd1-0ae3-40d5-b5dc-a3d3d2010b8b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:42 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d Sep 17 23:54:42 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:42 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:54:42 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:42 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5581a09-4531-41ce-a661-c21963e6cfe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e8b110-37f7-4b44-87df-c5ce6d99aad9]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:42 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:54:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:54:42 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 Sep 17 23:54:42 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:43 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5" returned: 0 in 0.677s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:43 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d Sep 17 23:54:43 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:43 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d" returned: 0 in 0.516s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:43 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d Sep 17 23:54:43 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:43 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5.86fe2668-e317-4e16-b51b-a6ea2e3b281d" returned: 0 in 0.303s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-86fe2668-e317-4e16-b51b-a6ea2e3b281d" released by "_delete_snapshot" :: held 2.102s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-c5581a09-4531-41ce-a661-c21963e6cfe5" released by "delete_snapshot" :: held 2.140s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:44 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['4ed0e7ee-a9db-4ea7-8464-33cae956de09', '238fc9aa-c053-43e3-ba28-38f4e689c46a', '318fa4c7-7a44-4151-97ba-0e34292411be', '0042e721-2248-40fe-b818-d48c7d102a55'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Delete snapshot completed successfully. Sep 17 23:54:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-32d4d582-2dcd-49cb-88b8-e555b8a04616 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-86fe2668-e317-4e16-b51b-a6ea2e3b281d-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-c5581a09-4531-41ce-a661-c21963e6cfe5-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-c5581a09-4531-41ce-a661-c21963e6cfe5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-c5581a09-4531-41ce-a661-c21963e6cfe5" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-c5581a09-4531-41ce-a661-c21963e6cfe5" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c927cb3d-90fc-4df3-8825-3eefcd39a7a7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:45 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 Sep 17 23:54:45 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:46 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5" returned: 0 in 0.713s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:46 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5 Sep 17 23:54:46 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:46 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c5581a09-4531-41ce-a661-c21963e6cfe5" returned: 0 in 0.480s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-c5581a09-4531-41ce-a661-c21963e6cfe5" released by "delete_volume" :: held 1.354s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['321e3158-f4c2-497f-97a9-e1c317afb8df', 'b939b98e-8625-4f49-a4d6-51bb50770fe7', '978954ff-77d6-4acb-a06e-4f92bd2d7bc2', 'c083d661-75ec-4109-bb47-a8b5ddcc5484'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:46 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:54:46 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:47 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:47 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:54:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Deleted volume successfully. Sep 17 23:54:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-477f72ee-5232-4400-8fae-563bc5bb36d9 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-c5581a09-4531-41ce-a661-c21963e6cfe5-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:DELETE=10,cinder:SELECT=110,cinder:INSERT=31,cinder:UPDATE=133 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (af7918dc-e142-496a-8a37-a0dca668dfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7056e4e2-1ea9-49c7-8909-8fc48d5344d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7056e4e2-1ea9-49c7-8909-8fc48d5344d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-802803043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fabe5a-c3db-476c-8a37-0c35f893532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:48Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a87940c-49cb-4369-9d21-6895871a5420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a87940c-49cb-4369-9d21-6895871a5420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9553a5d1-de9e-4736-9421-4b75a5416aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9553a5d1-de9e-4736-9421-4b75a5416aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fabe5a-c3db-476c-8a37-0c35f893532b', 'volume_name': 'volume-59fabe5a-c3db-476c-8a37-0c35f893532b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920c809b-e027-4586-b7e3-f6efa03c4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920c809b-e027-4586-b7e3-f6efa03c4628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1afb980-5daa-4286-b5d3-dd1fdfd2ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:48 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Volume 59fabe5a-c3db-476c-8a37-0c35f893532b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fabe5a-c3db-476c-8a37-0c35f893532b', 'volume_size': 1} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-802803043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fabe5a-c3db-476c-8a37-0c35f893532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:48Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Creating volume 59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:48 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:54:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:48 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b 1073741824 Sep 17 23:54:48 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:49 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b 1073741824" returned: 0 in 0.734s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:INSERT=37,cinder:UPDATE=148,cinder:DELETE=15,cinder:SELECT=100 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:49 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b Sep 17 23:54:49 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:49 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b" returned: 0 in 0.473s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1afb980-5daa-4286-b5d3-dd1fdfd2ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fabe5a-c3db-476c-8a37-0c35f893532b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918d1849-48c1-4350-80c8-586f6f7548d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:49 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Volume volume-59fabe5a-c3db-476c-8a37-0c35f893532b (59fabe5a-c3db-476c-8a37-0c35f893532b): created successfully Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918d1849-48c1-4350-80c8-586f6f7548d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:49 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (af7918dc-e142-496a-8a37-a0dca668dfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:49 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1b3c6386-a8cf-4810-96ce-8938f18d2c4f tempest-VolumesSnapshotTestJSON-520789526 None] Created volume successfully. Sep 17 23:54:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Creating offline snapshot 99029cf9-fc74-4e62-bccb-5ed2b72b9bec of volume 59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:54:50 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d013f24-df41-40cb-90f2-6d4c6dbdc015]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:51 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b Sep 17 23:54:51 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:51 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b" returned: 0 in 0.442s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:51 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec 1G Sep 17 23:54:51 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:51 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec 1G" returned: 0 in 0.478s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fabe5a-c3db-476c-8a37-0c35f893532b -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:51 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fabe5a-c3db-476c-8a37-0c35f893532b -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec Sep 17 23:54:51 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:52 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fabe5a-c3db-476c-8a37-0c35f893532b -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec" returned: 0 in 0.380s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:52 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec is being set with open permissions: ugo+rw Sep 17 23:54:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:52 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec Sep 17 23:54:52 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:52 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec" returned: 0 in 0.266s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:52 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.info Sep 17 23:54:52 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:52 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.info" returned: 0 in 0.283s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:52 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.info is being set with open permissions: ugo+rw Sep 17 23:54:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:52 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.info Sep 17 23:54:52 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:53 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.info" returned: 0 in 0.270s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d986e347-35f7-406c-8f37-bc7244852337 tempest-VolumesSnapshotTestJSON-520789526 None] Create snapshot completed successfully Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (c3535f7e-3052-437c-b4d1-54cd5f1b5df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc60a16e-ee13-4b4d-b0e8-d9656034ac2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc60a16e-ee13-4b4d-b0e8-d9656034ac2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-249163449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ed8c9b-d9eb-41fa-b882-b21f82b89c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abaab10bda6f4afc8d82b3cf2fd3d10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99029cf9-fc74-4e62-bccb-5ed2b72b9bec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:54:55Z,use_quota=True,user_id='cb5ce7952e3247ed91b92748787e478e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f0380a-996c-48f6-8b3f-9860d5b20609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f0380a-996c-48f6-8b3f-9860d5b20609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b755bca1-21ac-456f-bbb8-7d92aba57004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b755bca1-21ac-456f-bbb8-7d92aba57004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82ed8c9b-d9eb-41fa-b882-b21f82b89c26', 'volume_name': 'volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26', 'volume_size': 1, 'snapshot_id': '99029cf9-fc74-4e62-bccb-5ed2b72b9bec'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b2426e-6cfd-4eca-b796-3e073c8e8f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b2426e-6cfd-4eca-b796-3e073c8e8f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5919c2-6d68-46a6-b791-dbf4f64f7084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:54:54 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Volume 82ed8c9b-d9eb-41fa-b882-b21f82b89c26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26', 'volume_size': 1, 'snapshot_id': '99029cf9-fc74-4e62-bccb-5ed2b72b9bec'} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-99029cf9-fc74-4e62-bccb-5ed2b72b9bec-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-99029cf9-fc74-4e62-bccb-5ed2b72b9bec-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Creating volume 82ed8c9b-d9eb-41fa-b882-b21f82b89c26 from snapshot 99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] snapshot: 99029cf9-fc74-4e62-bccb-5ed2b72b9bec, volume: 82ed8c9b-d9eb-41fa-b882-b21f82b89c26, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:54:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2400a65b-6fe1-4054-956e-918f048c9ca3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:55 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec Sep 17 23:54:55 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:55 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec" returned: 0 in 0.443s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fabe5a-c3db-476c-8a37-0c35f893532b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2815021a-f34a-4519-a1bf-a546e64bf71c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:55 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b Sep 17 23:54:55 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:54:55 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b" returned: 0 in 0.458s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:54:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:54:55 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 Sep 17 23:54:55 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:03 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" returned: 0 in 7.995s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:03 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b, size 1024.00 MB, duration 8.00 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:55:03 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Converted 1024.00 MB image at 128.01 MB/s Sep 17 23:55:03 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 is being set with open permissions: ugo+rw Sep 17 23:55:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:03 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 Sep 17 23:55:03 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:04 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" released by "_copy_volume_from_snapshot" :: held 9.309s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-99029cf9-fc74-4e62-bccb-5ed2b72b9bec-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" released by "_create_volume_from_snapshot" :: held 9.391s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.412s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5919c2-6d68-46a6-b791-dbf4f64f7084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26', 'volume_size': 1, 'snapshot_id': '99029cf9-fc74-4e62-bccb-5ed2b72b9bec'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dea427e-e2d5-4dc1-a263-78912205adb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:04 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Volume volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 (82ed8c9b-d9eb-41fa-b882-b21f82b89c26): created successfully Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dea427e-e2d5-4dc1-a263-78912205adb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Flow 'volume_create_manager' (c3535f7e-3052-437c-b4d1-54cd5f1b5df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-135ba8f9-9cb4-40ba-b456-dd6eab4fc814 tempest-VolumesSnapshotTestJSON-520789526 None] Created volume successfully. Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-82ed8c9b-d9eb-41fa-b882-b21f82b89c26-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-82ed8c9b-d9eb-41fa-b882-b21f82b89c26-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3340a9b-73a4-49fa-916e-5e020b6282c8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:04 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:55:05 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 Sep 17 23:55:05 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Flow 'volume_create_manager' (719a56b5-f544-489a-a899-8128fd726616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb5435-b160-4d13-a8c5-7d187a9f32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb5435-b160-4d13-a8c5-7d187a9f32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1519300850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9335e7-1132-41a1-83ba-58d918977be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f028b57d594afd95cb30592cdd0021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:55:05Z,use_quota=True,user_id='372b08c686bf4e23bca8dd65bb1f1761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d57b8ba-56ec-4026-b743-ae136d1625fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d57b8ba-56ec-4026-b743-ae136d1625fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c42bc0-f6cb-44d1-86b8-0329c9d14b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c42bc0-f6cb-44d1-86b8-0329c9d14b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9335e7-1132-41a1-83ba-58d918977be1', 'volume_name': 'volume-5d9335e7-1132-41a1-83ba-58d918977be1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd35c5d-513b-4c10-a8df-94c0483165e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd35c5d-513b-4c10-a8df-94c0483165e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6ba9fd-4ffa-4c43-832c-1a77b370f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:05 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Volume 5d9335e7-1132-41a1-83ba-58d918977be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9335e7-1132-41a1-83ba-58d918977be1', 'volume_size': 1} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1519300850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9335e7-1132-41a1-83ba-58d918977be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f028b57d594afd95cb30592cdd0021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:55:05Z,use_quota=True,user_id='372b08c686bf4e23bca8dd65bb1f1761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Creating volume 5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:55:05 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:05 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 1073741824 Sep 17 23:55:05 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:05 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:05 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26 Sep 17 23:55:05 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:05 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" returned: 0 in 0.265s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:05 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 1073741824" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-82ed8c9b-d9eb-41fa-b882-b21f82b89c26" released by "delete_volume" :: held 0.670s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:05 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 Sep 17 23:55:05 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['b479cd54-a573-42b2-b59b-6c83a958cd86', '1ea745d8-39d1-4a46-a18e-77491fec56cb', '6701aea8-8813-4a9b-b595-3c637234f464', '2f2ec70d-b7e5-4890-93bf-96e04538f3da'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:05 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:05 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:05 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1" returned: 0 in 0.288s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6ba9fd-4ffa-4c43-832c-1a77b370f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9335e7-1132-41a1-83ba-58d918977be1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ff5ec-fc76-4866-b27f-83c78de7d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:05 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Volume volume-5d9335e7-1132-41a1-83ba-58d918977be1 (5d9335e7-1132-41a1-83ba-58d918977be1): created successfully Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ff5ec-fc76-4866-b27f-83c78de7d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:05 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Flow 'volume_create_manager' (719a56b5-f544-489a-a899-8128fd726616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-00cc9df6-a3fa-412d-bff1-34bfffd9e451 tempest-SnapshotDependencyTests-1187507568 None] Created volume successfully. Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-99029cf9-fc74-4e62-bccb-5ed2b72b9bec-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:06 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-99029cf9-fc74-4e62-bccb-5ed2b72b9bec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-59fabe5a-c3db-476c-8a37-0c35f893532b" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Deleted volume successfully. Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-59fabe5a-c3db-476c-8a37-0c35f893532b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-99029cf9-fc74-4e62-bccb-5ed2b72b9bec" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-7a5415a7-2b97-461c-8fac-2091d51c062a tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-82ed8c9b-d9eb-41fa-b882-b21f82b89c26-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-99029cf9-fc74-4e62-bccb-5ed2b72b9bec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Deleting offline snapshot 99029cf9-fc74-4e62-bccb-5ed2b72b9bec of volume 59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] snapshot_file for this snap is: volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[49289be3-eb31-4cd9-821a-afdbb5fcafe0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:06 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec Sep 17 23:55:06 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Creating offline snapshot 0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 of volume 5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdcb588-9ecd-4890-89b9-82f0406cb63e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:06 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 Sep 17 23:55:06 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:06 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fabe5a-c3db-476c-8a37-0c35f893532b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89929c7-1854-4d38-a65a-065066a62bee]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:06 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b Sep 17 23:55:06 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:06 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1" returned: 0 in 0.415s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:06 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 1G Sep 17 23:55:06 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:07 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b" returned: 0 in 0.596s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:07 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 1G" returned: 0 in 0.400s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9335e7-1132-41a1-83ba-58d918977be1 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:07 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec Sep 17 23:55:07 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:07 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9335e7-1132-41a1-83ba-58d918977be1 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 Sep 17 23:55:07 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:07 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9335e7-1132-41a1-83ba-58d918977be1 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" returned: 0 in 0.330s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:07 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 is being set with open permissions: ugo+rw Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:07 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 Sep 17 23:55:07 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:07 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec" returned: 0 in 0.384s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:07 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec Sep 17 23:55:07 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:07 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" returned: 0 in 0.244s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:07 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b.99029cf9-fc74-4e62-bccb-5ed2b72b9bec" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:07 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.info Sep 17 23:55:07 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-99029cf9-fc74-4e62-bccb-5ed2b72b9bec" released by "_delete_snapshot" :: held 1.816s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-59fabe5a-c3db-476c-8a37-0c35f893532b" released by "delete_snapshot" :: held 1.850s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['51f4cd1d-13e8-4aa7-b284-9c624fb265fa', '5d40eb8f-0b0a-4985-b21b-1022364ad50e', '1958f2d4-89ea-43c0-becc-564e30399d84', 'f58610c0-f481-4112-bec1-c8cdd18a45d5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Delete snapshot completed successfully. Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f5543e-6ef6-47f1-a99f-fe360df012d2 tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-99029cf9-fc74-4e62-bccb-5ed2b72b9bec-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:08 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.info" returned: 0 in 0.270s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:08 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.info is being set with open permissions: ugo+rw Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:08 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.info Sep 17 23:55:08 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-59fabe5a-c3db-476c-8a37-0c35f893532b-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-59fabe5a-c3db-476c-8a37-0c35f893532b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-59fabe5a-c3db-476c-8a37-0c35f893532b" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-59fabe5a-c3db-476c-8a37-0c35f893532b" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1062423-c8c8-4b27-aa50-586b5a4aa9ab]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:08 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.info" returned: 0 in 0.304s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-be625de7-ee13-4a48-99d6-c4f4c6eb968b tempest-SnapshotDependencyTests-1187507568 None] Create snapshot completed successfully Sep 17 23:55:08 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b Sep 17 23:55:08 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:08 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b" returned: 0 in 0.363s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:08 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b Sep 17 23:55:08 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:09 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-59fabe5a-c3db-476c-8a37-0c35f893532b" returned: 0 in 0.241s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-59fabe5a-c3db-476c-8a37-0c35f893532b" released by "delete_volume" :: held 0.682s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['f4aa293b-5f10-43f5-baa8-5e412f08f95c', '031c5c4a-1b99-4fae-8741-46c85f561677', '9d43ecc4-dc57-4603-ac8e-fe3d7ecff7a1', '0feb6aa6-4475-4136-a277-a8efc31793ec'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:09 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:09 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:09 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.257s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:09 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Deleted volume successfully. Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8f6721ab-dcd6-41dd-a2d5-29c81f8ca35d tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-59fabe5a-c3db-476c-8a37-0c35f893532b-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-ba39c201-31dc-45f0-82d1-05ec4cd0380c-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-ba39c201-31dc-45f0-82d1-05ec4cd0380c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "cinder-quobyte-ba39c201-31dc-45f0-82d1-05ec4cd0380c" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-ba39c201-31dc-45f0-82d1-05ec4cd0380c" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1e0d67-fd9c-43a6-91c2-3c2fb86b9c7f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:09 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c Sep 17 23:55:09 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:10 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c" returned: 0 in 0.395s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:10 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c Sep 17 23:55:10 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Flow 'volume_create_manager' (b35e6365-51e7-4ada-bb6e-3720e3954446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b551bb6-b379-401c-9e7a-f4b8cec00fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b551bb6-b379-401c-9e7a-f4b8cec00fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7007634-9b63-4a16-9653-c185f2e537f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f028b57d594afd95cb30592cdd0021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0efc5513-68f3-45b0-b652-8cdc9dd6c4e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:55:10Z,use_quota=True,user_id='372b08c686bf4e23bca8dd65bb1f1761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7a33c9-b12d-4263-8918-96b36303e615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7a33c9-b12d-4263-8918-96b36303e615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6b00ca-a811-4509-a3c4-8d93bb9aab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6b00ca-a811-4509-a3c4-8d93bb9aab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7007634-9b63-4a16-9653-c185f2e537f7', 'volume_name': 'volume-a7007634-9b63-4a16-9653-c185f2e537f7', 'volume_size': 1, 'snapshot_id': '0efc5513-68f3-45b0-b652-8cdc9dd6c4e5'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc56d096-9c88-4fdc-acae-0099bff64326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc56d096-9c88-4fdc-acae-0099bff64326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c621ad2-3da3-4b8f-bc59-2ed5f14b04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Volume a7007634-9b63-4a16-9653-c185f2e537f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7007634-9b63-4a16-9653-c185f2e537f7', 'volume_size': 1, 'snapshot_id': '0efc5513-68f3-45b0-b652-8cdc9dd6c4e5'} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-quobyte-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5-a7007634-9b63-4a16-9653-c185f2e537f7" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5-a7007634-9b63-4a16-9653-c185f2e537f7" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Creating volume a7007634-9b63-4a16-9653-c185f2e537f7 from snapshot 0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-quobyte-a7007634-9b63-4a16-9653-c185f2e537f7" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-a7007634-9b63-4a16-9653-c185f2e537f7" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] snapshot: 0efc5513-68f3-45b0-b652-8cdc9dd6c4e5, volume: a7007634-9b63-4a16-9653-c185f2e537f7, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b22b2-8a7a-4744-8995-51cb64db645d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:10 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ba39c201-31dc-45f0-82d1-05ec4cd0380c" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-quobyte-ba39c201-31dc-45f0-82d1-05ec4cd0380c" released by "delete_volume" :: held 0.731s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Created reservations ['6189d0d9-dd69-4235-bfd2-27fbd7126832', '75aec5ec-60b6-484c-b582-04244d553844', '030bb030-facd-4f15-a166-aeade8a90456', '3fafb069-1763-4ecb-8be0-2eb73ce8bd9c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:10 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 Sep 17 23:55:10 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:10 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:10 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:10 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.284s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:10 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" returned: 0 in 0.430s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d9335e7-1132-41a1-83ba-58d918977be1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:55:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Deleted volume successfully. Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e077bf-3d09-4277-b799-2a425dfbe207]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0329a560-185b-442c-80b7-ce7802560fcb tempest-VolumesSnapshotTestJSON-520789526 None] Lock "cinder-ba39c201-31dc-45f0-82d1-05ec4cd0380c-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:10 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 Sep 17 23:55:10 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:11 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1" returned: 0 in 0.419s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:55:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:55:11 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:55:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:11 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 Sep 17 23:55:11 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-692d9067-df20-498c-86dd-6258f27a70db req-19ae1792-2736-4a84-ab0a-60fb96c688c2 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:18 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7" returned: 0 in 7.748s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:18 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:55:18 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Converted 1024.00 MB image at 132.14 MB/s Sep 17 23:55:18 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 is being set with open permissions: ugo+rw Sep 17 23:55:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:19 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 Sep 17 23:55:19 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:19 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7" returned: 0 in 0.302s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-a7007634-9b63-4a16-9653-c185f2e537f7" released by "_copy_volume_from_snapshot" :: held 8.986s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5-a7007634-9b63-4a16-9653-c185f2e537f7" released by "_create_volume_from_snapshot" :: held 9.072s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.089s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-692d9067-df20-498c-86dd-6258f27a70db req-19ae1792-2736-4a84-ab0a-60fb96c688c2 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.870s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-692d9067-df20-498c-86dd-6258f27a70db req-19ae1792-2736-4a84-ab0a-60fb96c688c2 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c621ad2-3da3-4b8f-bc59-2ed5f14b04d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7007634-9b63-4a16-9653-c185f2e537f7', 'volume_size': 1, 'snapshot_id': '0efc5513-68f3-45b0-b652-8cdc9dd6c4e5'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1bedb6-3498-49f6-844f-751a07a4651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:19 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Volume volume-a7007634-9b63-4a16-9653-c185f2e537f7 (a7007634-9b63-4a16-9653-c185f2e537f7): created successfully Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1bedb6-3498-49f6-844f-751a07a4651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Flow 'volume_create_manager' (b35e6365-51e7-4ada-bb6e-3720e3954446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-692d9067-df20-498c-86dd-6258f27a70db req-19ae1792-2736-4a84-ab0a-60fb96c688c2 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-aa76b229-131f-479b-9428-ade83db07a9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d776775-844e-422c-bef1-6a221c63da4c', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:55:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-84eafad6-0859-4c51-9274-99832897d75e tempest-SnapshotDependencyTests-1187507568 None] Created volume successfully. Sep 17 23:55:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-692d9067-df20-498c-86dd-6258f27a70db req-19ae1792-2736-4a84-ab0a-60fb96c688c2 tempest-TestServerVolumeAttachmentScenario-1850483239 None] attachment_update completed successfully. Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-quobyte-5d9335e7-1132-41a1-83ba-58d918977be1" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-5d9335e7-1132-41a1-83ba-58d918977be1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-quobyte-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Deleting offline snapshot 0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 of volume 5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] snapshot_file for this snap is: volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2cc863-734d-441f-a956-6acb6609b24c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:20 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 Sep 17 23:55:20 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:20 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" returned: 0 in 0.425s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d9335e7-1132-41a1-83ba-58d918977be1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6733c2-b896-4716-9702-0b75632caf28]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:20 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 Sep 17 23:55:20 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:21 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1" returned: 0 in 0.618s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:21 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 Sep 17 23:55:21 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:21 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" returned: 0 in 0.428s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:21 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5 Sep 17 23:55:21 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:22 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1.0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5" released by "_delete_snapshot" :: held 1.920s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-5d9335e7-1132-41a1-83ba-58d918977be1" released by "delete_snapshot" :: held 1.958s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Created reservations ['4c413ad1-582f-41ad-83df-07af78280965', '36ccdc2f-3c30-49f2-b75d-b541a1ce083d', '74910f40-c4d5-4d51-84a6-34151e778dc8', 'a73e018f-cb4f-48d0-ad67-aec92349d7ad'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Delete snapshot completed successfully. Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d866629d-2b1e-4ccf-8ccf-ac69806b81c7 tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-0efc5513-68f3-45b0-b652-8cdc9dd6c4e5-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-5d9335e7-1132-41a1-83ba-58d918977be1-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-5d9335e7-1132-41a1-83ba-58d918977be1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-quobyte-5d9335e7-1132-41a1-83ba-58d918977be1" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-5d9335e7-1132-41a1-83ba-58d918977be1" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446746c-bd60-4d46-8283-5255f1e07cb3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:22 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 Sep 17 23:55:22 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:22 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1" returned: 0 in 0.426s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:23 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1 Sep 17 23:55:23 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:23 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5d9335e7-1132-41a1-83ba-58d918977be1" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-5d9335e7-1132-41a1-83ba-58d918977be1" released by "delete_volume" :: held 0.781s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Created reservations ['f1994950-6193-45d6-97bf-009d24b1a360', 'abccb36d-4a30-48d9-a8a8-b273c7266cf5', '147cc8e8-bb43-4620-8c67-3b70e5e5e93c', '89807107-acc4-43d0-be88-05391c1ed8df'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:23 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:23 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-a7007634-9b63-4a16-9653-c185f2e537f7-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-a7007634-9b63-4a16-9653-c185f2e537f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:23 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.311s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "cinder-quobyte-a7007634-9b63-4a16-9653-c185f2e537f7" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:23 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Deleted volume successfully. Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-a7007634-9b63-4a16-9653-c185f2e537f7" acquired by "delete_volume" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-da7eb7e1-9f5a-4363-b4c2-9d404fbcc06a tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-5d9335e7-1132-41a1-83ba-58d918977be1-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[81920f2d-3d6e-4b6f-9713-cab928013d79]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:23 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 Sep 17 23:55:23 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:24 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7" returned: 0 in 0.463s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:24 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7 Sep 17 23:55:24 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-3507c915-ba43-4ced-b5c7-82b19c6d05bf req-729ce351-d032-4d41-bf74-06285f124ba5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-3507c915-ba43-4ced-b5c7-82b19c6d05bf req-729ce351-d032-4d41-bf74-06285f124ba5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [req-3507c915-ba43-4ced-b5c7-82b19c6d05bf req-729ce351-d032-4d41-bf74-06285f124ba5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-3507c915-ba43-4ced-b5c7-82b19c6d05bf req-729ce351-d032-4d41-bf74-06285f124ba5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43', 'name': 'volume-efe47860-fed5-4df7-8cab-bfb15a870da8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f07406a4-a522-4714-bd04-c885c5b163ed', 'enforce_multipath': True} {{(pid=85956) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 23:55:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-3507c915-ba43-4ced-b5c7-82b19c6d05bf req-729ce351-d032-4d41-bf74-06285f124ba5 tempest-TestServerVolumeAttachmentScenario-1850483239 None] attachment_update completed successfully. Sep 17 23:55:24 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a7007634-9b63-4a16-9653-c185f2e537f7" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-quobyte-a7007634-9b63-4a16-9653-c185f2e537f7" released by "delete_volume" :: held 0.811s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Created reservations ['49802d5e-6e5b-4dd7-8684-a1f1683e674b', '44ce0431-26d3-47fe-93a6-809dba5b6ea2', '683b7424-29d6-428f-bef6-7ad7c6fc98fd', '99713e77-8009-4246-8182-f75c7e31b51a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:24 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:24 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:25 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.394s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:25 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Deleted volume successfully. Sep 17 23:55:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9a5ac64d-58f3-490c-82ff-db298c6b8f8e tempest-SnapshotDependencyTests-1187507568 None] Lock "cinder-a7007634-9b63-4a16-9653-c185f2e537f7-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:25 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-63e11677-dc5a-4cf6-a863-532186cc601a req-0d447430-d599-41cb-bfee-4f0542288a84 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Terminate volume connection completed successfully. Sep 17 23:55:25 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-63e11677-dc5a-4cf6-a863-532186cc601a req-0d447430-d599-41cb-bfee-4f0542288a84 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Deleting attachment f07406a4-a522-4714-bd04-c885c5b163ed. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:55:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [req-916d2c4e-94f7-4436-98f8-f0a709c8c3cf req-519131e9-d796-4ce8-a350-9eb9a6315d04 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Terminate volume connection completed successfully. Sep 17 23:55:27 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [req-916d2c4e-94f7-4436-98f8-f0a709c8c3cf req-519131e9-d796-4ce8-a350-9eb9a6315d04 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Deleting attachment 3d776775-844e-422c-bef1-6a221c63da4c. {{(pid=85956) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 23:55:37 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=63,cinder:UPDATE=65,cinder:INSERT=17,cinder:DELETE=8 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:55:37 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=72,cinder:SELECT=72,cinder:DELETE=3,cinder:INSERT=17 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "cinder-efe47860-fed5-4df7-8cab-bfb15a870da8-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-efe47860-fed5-4df7-8cab-bfb15a870da8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "cinder-quobyte-efe47860-fed5-4df7-8cab-bfb15a870da8" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-quobyte-efe47860-fed5-4df7-8cab-bfb15a870da8" acquired by "delete_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8954f104-ac3e-4c64-adf0-fda38ac1b10c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:39 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 Sep 17 23:55:39 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:39 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8" returned: 0 in 0.472s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:39 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8 Sep 17 23:55:39 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:40 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-efe47860-fed5-4df7-8cab-bfb15a870da8" returned: 0 in 0.359s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-quobyte-efe47860-fed5-4df7-8cab-bfb15a870da8" released by "delete_volume" :: held 0.890s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Created reservations ['d3b1e6f7-4ab7-480c-9d9c-1071e19d6f3c', '03001c8c-b02f-4187-9504-7b74857b5b2f', 'e2894ec0-4d61-4243-941b-680a4d88e95b', 'd0e92ffc-06f6-438c-9597-304ca9498e39'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:40 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:40 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "cinder-aa76b229-131f-479b-9428-ade83db07a9f-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-aa76b229-131f-479b-9428-ade83db07a9f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "cinder-quobyte-aa76b229-131f-479b-9428-ade83db07a9f" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-quobyte-aa76b229-131f-479b-9428-ade83db07a9f" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a54e0df-9eab-4e35-ae80-be6476636ea3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:40 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f Sep 17 23:55:40 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:40 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.484s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Deleted volume successfully. Sep 17 23:55:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8438d88a-e9f3-4964-b3fe-7a9187d29a59 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-efe47860-fed5-4df7-8cab-bfb15a870da8-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:41 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f" returned: 0 in 0.514s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:41 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f Sep 17 23:55:41 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:41 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-aa76b229-131f-479b-9428-ade83db07a9f" returned: 0 in 0.291s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-quobyte-aa76b229-131f-479b-9428-ade83db07a9f" released by "delete_volume" :: held 0.869s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Created reservations ['5f5f0bd5-0a82-4401-809a-3b24c6bea11e', '23fab1d6-9f3e-4b10-a67b-9b97ca553a82', '25439016-5a07-4f34-97a3-c0e1b3304362', '427801db-1d4f-40cd-bede-68401ea8ba73'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:41 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:41 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:42 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.389s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Deleted volume successfully. Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dac906d4-1966-4a31-881c-f004a2384d17 tempest-TestServerVolumeAttachmentScenario-1850483239 None] Lock "cinder-aa76b229-131f-479b-9428-ade83db07a9f-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:42 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:55:42 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:42 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.270s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:55:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Flow 'volume_create_manager' (10f9f02a-ccc5-4850-b457-325a099e0053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0bd210-cad3-4ca6-9a32-a0deb164c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0bd210-cad3-4ca6-9a32-a0deb164c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1324908647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c167b65d-16b2-4395-9b22-9aecf8446987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b683a64c2754b1da44fd95fdfa071a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:55:47Z,use_quota=True,user_id='e1fae2fccec849e98456b178d137d2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ccf606-79ab-4683-a438-10bcae901aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ccf606-79ab-4683-a438-10bcae901aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f074e180-611c-4667-bb74-e85ebea015ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f074e180-611c-4667-bb74-e85ebea015ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c167b65d-16b2-4395-9b22-9aecf8446987', 'volume_name': 'volume-c167b65d-16b2-4395-9b22-9aecf8446987', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97584d4-6a84-4290-ba86-a76c4e395d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97584d4-6a84-4290-ba86-a76c4e395d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283d7d30-75e2-453b-b73e-17f966aaa047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:46 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Volume c167b65d-16b2-4395-9b22-9aecf8446987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c167b65d-16b2-4395-9b22-9aecf8446987', 'volume_size': 1} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1324908647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c167b65d-16b2-4395-9b22-9aecf8446987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b683a64c2754b1da44fd95fdfa071a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:55:47Z,use_quota=True,user_id='e1fae2fccec849e98456b178d137d2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Creating volume c167b65d-16b2-4395-9b22-9aecf8446987 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:55:46 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:55:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:46 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 1073741824 Sep 17 23:55:46 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:47 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 1073741824" returned: 0 in 0.445s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:47 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 Sep 17 23:55:47 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:47 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987" returned: 0 in 0.264s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283d7d30-75e2-453b-b73e-17f966aaa047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c167b65d-16b2-4395-9b22-9aecf8446987', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242152bd-e310-4d28-b926-2266d2792257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:47 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Volume volume-c167b65d-16b2-4395-9b22-9aecf8446987 (c167b65d-16b2-4395-9b22-9aecf8446987): created successfully Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242152bd-e310-4d28-b926-2266d2792257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Flow 'volume_create_manager' (10f9f02a-ccc5-4850-b457-325a099e0053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-856e7962-3a73-4878-bd66-6285d0be3064 tempest-TestImageHashVerification-1837124339 None] Created volume successfully. Sep 17 23:55:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:55:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:55:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8c6658-a0d8-4601-ac12-d2b2cb28c19a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:48 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 Sep 17 23:55:48 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:48 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987" returned: 0 in 0.409s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b412d68-9e2f-45ac-bf67-b5fb24894d6d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:49 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 Sep 17 23:55:49 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:49 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987" returned: 0 in 0.356s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 /opt/stack/data/cinder/conversion/c167b65d-16b2-4395-9b22-9aecf8446987.temp_image.31ba273e-af4c-460e-8a7b-e381bcbba7725__lm8sh.img {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:49 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 /opt/stack/data/cinder/conversion/c167b65d-16b2-4395-9b22-9aecf8446987.temp_image.31ba273e-af4c-460e-8a7b-e381bcbba7725__lm8sh.img Sep 17 23:55:49 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:56 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 /opt/stack/data/cinder/conversion/c167b65d-16b2-4395-9b22-9aecf8446987.temp_image.31ba273e-af4c-460e-8a7b-e381bcbba7725__lm8sh.img" returned: 0 in 6.924s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:56 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4322df-6c44-47bf-bb52-2de9ffd95bb8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:56 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 Sep 17 23:55:56 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:56 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987" returned: 0 in 0.572s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:56 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/conversion/c167b65d-16b2-4395-9b22-9aecf8446987.temp_image.31ba273e-af4c-460e-8a7b-e381bcbba7725__lm8sh.img {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:55:56 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Converted 1024.00 MB image at 147.87 MB/s Sep 17 23:55:56 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] 31ba273e-af4c-460e-8a7b-e381bcbba772 was raw, no need to convert to raw {{(pid=85956) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=21,cinder:DELETE=3 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Flow 'volume_create_manager' (ccb626e1-131a-421d-92b3-4520872f2594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3c3558-1c73-4ab6-8a94-763639bcf362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3c3558-1c73-4ab6-8a94-763639bcf362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb7cf62-7af7-4462-9510-0eaf05bfc0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe6f1e758cd43668359f296e52705ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:55:59Z,use_quota=True,user_id='f070eb636e4c47a09a0c94bca797737e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e660486-4fb9-4583-b07d-45d03fa88bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e660486-4fb9-4583-b07d-45d03fa88bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787d8df4-16a4-4e93-8c3c-5622ef6c6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:58 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787d8df4-16a4-4e93-8c3c-5622ef6c6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2cb7cf62-7af7-4462-9510-0eaf05bfc0a2', 'volume_name': 'volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2', 'volume_size': 1, 'image_id': '8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ef25f55843f30ed5b6656be368456c4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbe6f1e758cd43668359f296e52705ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6257311b86136ca185aa1b8cdfe7868ca41b2c8c7a8d9c893b4b517f94590058ab35b95f3fa0f46c11cc83459747d5c8661a5be6761330fd06be993d8860cf1', 'id': '8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'created_at': datetime.datetime(2026, 9, 17, 21, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42/file', 'properties': {}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502cef72-9fb7-4584-a596-cff1f0d1d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502cef72-9fb7-4584-a596-cff1f0d1d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0c13a5-797d-458f-a558-f3003b92b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:55:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Volume 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2', 'volume_size': 1, 'image_id': '8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ef25f55843f30ed5b6656be368456c4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbe6f1e758cd43668359f296e52705ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6257311b86136ca185aa1b8cdfe7868ca41b2c8c7a8d9c893b4b517f94590058ab35b95f3fa0f46c11cc83459747d5c8661a5be6761330fd06be993d8860cf1', 'id': '8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'created_at': datetime.datetime(2026, 9, 17, 21, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42/file', 'properties': {}}, 'image_service': } Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Trying to clone 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 from image 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:55:59 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Image download 0.00 MB at 0.00 MB/s Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7381484-4d82-4494-a205-835c4ebcee8a]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:59 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD Sep 17 23:55:59 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:59 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:55:59 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD Sep 17 23:55:59 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:55:59 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:55:59 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Temporary image 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 is fetched for user f070eb636e4c47a09a0c94bca797737e. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:56:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[00722b0f-5dcd-4593-9399-ec7ec2b8373a]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:00 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD Sep 17 23:56:00 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:00 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:00 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD Sep 17 23:56:00 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:00 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD" returned: 1 in 0.370s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:56:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:10 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=3 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:56:10 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=18,cinder:SELECT=18,cinder:INSERT=6 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.351s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Uploaded volume to glance image-id: 31ba273e-af4c-460e-8a7b-e381bcbba772. {{(pid=85956) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.093s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb7cf62-7af7-4462-9510-0eaf05bfc0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe6f1e758cd43668359f296e52705ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:55:59Z,use_quota=True,user_id='f070eb636e4c47a09a0c94bca797737e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Creating volume 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:56:14 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:56:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:14 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 1073741824 Sep 17 23:56:14 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-023ef65b-6d68-4870-a0e1-a47e4f8f74df tempest-TestImageHashVerification-1837124339 None] Copy volume to image completed successfully. Sep 17 23:56:15 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 1073741824" returned: 0 in 0.401s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:15 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 Sep 17 23:56:15 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:15 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Attempting download of 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'metadata': {}}])) to volume 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2acf1-09f3-4d12-9571-a8fceff6abec]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_oyuwxjc4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:15 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_oyuwxjc4 Sep 17 23:56:15 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Acquiring lock "cinder-c167b65d-16b2-4395-9b22-9aecf8446987-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Lock "cinder-c167b65d-16b2-4395-9b22-9aecf8446987-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:15 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_oyuwxjc4" returned: 0 in 0.352s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_oyuwxjc4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Acquiring lock "cinder-quobyte-c167b65d-16b2-4395-9b22-9aecf8446987" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Lock "cinder-quobyte-c167b65d-16b2-4395-9b22-9aecf8446987" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6735b6f-839b-4dbf-bb0b-3926bd5c4b34]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:16 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_oyuwxjc4 Sep 17 23:56:16 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:16 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 Sep 17 23:56:16 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:16 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_oyuwxjc4" returned: 1 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_oyuwxjc4' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa915133-8a2c-4cba-85b4-4e3ceece86b1]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:16 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987" returned: 0 in 0.369s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:16 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD Sep 17 23:56:16 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:16 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987 Sep 17 23:56:16 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:16 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:16 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c167b65d-16b2-4395-9b22-9aecf8446987" returned: 0 in 0.262s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Lock "cinder-quobyte-c167b65d-16b2-4395-9b22-9aecf8446987" released by "delete_volume" :: held 0.675s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Created reservations ['c8102eaa-d14e-429d-ac10-92f55b111c2a', 'ba7f5b40-d7e8-44bf-9f09-2fbc121bcc2a', 'af461447-bd52-4377-ad08-4d0830b7d7b7', 'e779cd9e-ecb3-4ee7-a86a-07e5251eeb65'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:56:16 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD Sep 17 23:56:16 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:16 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:56:16 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:17 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 was raw, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:17 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 Sep 17 23:56:17 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:17 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.266s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:56:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Deleted volume successfully. Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-27469630-5232-4a2e-a168-7d9c871279a9 tempest-TestImageHashVerification-1837124339 None] Lock "cinder-c167b65d-16b2-4395-9b22-9aecf8446987-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:17 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2" returned: 0 in 0.463s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b3e825c-6c87-4a9c-b5e5-6244367c3e42_v828z206devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:56:17 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:17 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 1G Sep 17 23:56:17 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:17 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 1G" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Downloaded image 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'metadata': {}}])) to volume 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Temporary image 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 for user f070eb636e4c47a09a0c94bca797737e is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Marking volume 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Copying metadata from image 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 to 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Creating volume glance metadata for volume 2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 backed by image 8b3e825c-6c87-4a9c-b5e5-6244367c3e42 with: {'image_id': '8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2ef25f55843f30ed5b6656be368456c4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0c13a5-797d-458f-a558-f3003b92b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2', 'volume_size': 1, 'image_id': '8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ef25f55843f30ed5b6656be368456c4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbe6f1e758cd43668359f296e52705ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6257311b86136ca185aa1b8cdfe7868ca41b2c8c7a8d9c893b4b517f94590058ab35b95f3fa0f46c11cc83459747d5c8661a5be6761330fd06be993d8860cf1', 'id': '8b3e825c-6c87-4a9c-b5e5-6244367c3e42', 'created_at': datetime.datetime(2026, 9, 17, 21, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b3e825c-6c87-4a9c-b5e5-6244367c3e42/file', 'properties': {}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15133739-ab6c-4758-a21d-742b012fd419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:17 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Volume volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 (2cb7cf62-7af7-4462-9510-0eaf05bfc0a2): created successfully Sep 17 23:56:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15133739-ab6c-4758-a21d-742b012fd419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Flow 'volume_create_manager' (ccb626e1-131a-421d-92b3-4520872f2594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:56:18 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-240dd32d-16f5-4870-b166-0a918792eaf4 tempest-VolumeImageDependencyTests-7123801 None] Created volume successfully. Sep 17 23:56:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Acquiring lock "cinder-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Lock "cinder-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Acquiring lock "cinder-quobyte-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Lock "cinder-quobyte-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69e2985-0022-4fb2-942f-803f5c276ecc]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:19 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 Sep 17 23:56:19 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:19 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2" returned: 0 in 0.378s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:19 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2 Sep 17 23:56:19 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:19 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2" returned: 0 in 0.272s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Lock "cinder-quobyte-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2" released by "delete_volume" :: held 0.711s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Created reservations ['b1301ddc-9bc5-4831-897b-6b65be503353', 'e343197f-a056-4f86-ac2a-9551f9ee29a8', '939aec64-f7db-4a15-ac49-3a2167dfedc6', '6484a05b-769b-4e99-85eb-e5765732e255'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:19 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:56:19 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:20 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.245s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:20 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:56:20 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Deleted volume successfully. Sep 17 23:56:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b9e05248-2444-4c2c-b75a-2927598075ce tempest-VolumeImageDependencyTests-7123801 None] Lock "cinder-2cb7cf62-7af7-4462-9510-0eaf05bfc0a2-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:29 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=23,cinder:SELECT=16,cinder:INSERT=10,cinder:DELETE=1 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:56:30 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=17,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=2 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Flow 'volume_create_manager' (0c182850-afc1-4e46-8bd0-6aeddce0687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ae0362-c368-4216-a03c-e8408c55cb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ae0362-c368-4216-a03c-e8408c55cb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f22963d-19d4-43d9-9951-a8f0e38070af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4adee0924dd846939029ebb6591a7299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:56:32Z,use_quota=True,user_id='238f3a05aa3e45f48c8ddb5f7cd1f20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752d62a5-61e7-4330-87c9-89302b0430ea),volume_type_id=752d62a5-61e7-4330-87c9-89302b0430ea)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137c8be7-bf6c-47e4-ae14-9b9e128fa553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137c8be7-bf6c-47e4-ae14-9b9e128fa553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73af783-fa25-47b4-8ed5-50c0a191eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73af783-fa25-47b4-8ed5-50c0a191eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f22963d-19d4-43d9-9951-a8f0e38070af', 'volume_name': 'volume-2f22963d-19d4-43d9-9951-a8f0e38070af', 'volume_size': 1, 'image_id': '9375aa43-47cc-42a9-b8af-7a05c3120154', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9375aa43-47cc-42a9-b8af-7a05c3120154', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba4d3b4ec162a13d120857d8e7c7866b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4adee0924dd846939029ebb6591a7299', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bc68ea1c36fd8174fc9d91815f112804a9e957a2080735cb06ac6f22a1e86dda845fa9270b71f08cf367e6bc1d587e561a7d6d28976e3ae8ae6e65cb4e28edb', 'id': '9375aa43-47cc-42a9-b8af-7a05c3120154', 'created_at': datetime.datetime(2026, 9, 17, 21, 56, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 56, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9375aa43-47cc-42a9-b8af-7a05c3120154/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef65dd40-4264-4f80-9cae-dfa222da191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef65dd40-4264-4f80-9cae-dfa222da191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc70b477-8907-4d06-8486-9cfae2ead13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:32 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Volume 2f22963d-19d4-43d9-9951-a8f0e38070af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f22963d-19d4-43d9-9951-a8f0e38070af', 'volume_size': 1, 'image_id': '9375aa43-47cc-42a9-b8af-7a05c3120154', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9375aa43-47cc-42a9-b8af-7a05c3120154', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba4d3b4ec162a13d120857d8e7c7866b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4adee0924dd846939029ebb6591a7299', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bc68ea1c36fd8174fc9d91815f112804a9e957a2080735cb06ac6f22a1e86dda845fa9270b71f08cf367e6bc1d587e561a7d6d28976e3ae8ae6e65cb4e28edb', 'id': '9375aa43-47cc-42a9-b8af-7a05c3120154', 'created_at': datetime.datetime(2026, 9, 17, 21, 56, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 56, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9375aa43-47cc-42a9-b8af-7a05c3120154/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Trying to clone 2f22963d-19d4-43d9-9951-a8f0e38070af from image 9375aa43-47cc-42a9-b8af-7a05c3120154 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9375aa43-47cc-42a9-b8af-7a05c3120154', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:56:32 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Image download 0.00 MB at 0.00 MB/s Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3545c15f-eb5c-415e-a27d-21ab2ffa8ade]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:32 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD Sep 17 23:56:32 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:32 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:32 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD Sep 17 23:56:32 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:33 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Temporary image 9375aa43-47cc-42a9-b8af-7a05c3120154 is fetched for user 238f3a05aa3e45f48c8ddb5f7cd1f20e. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5c2a1-2f9f-4d69-9ff7-d6ed153474f6]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:33 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD Sep 17 23:56:33 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:33 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:33 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD Sep 17 23:56:33 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:33 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f22963d-19d4-43d9-9951-a8f0e38070af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4adee0924dd846939029ebb6591a7299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:56:32Z,use_quota=True,user_id='238f3a05aa3e45f48c8ddb5f7cd1f20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752d62a5-61e7-4330-87c9-89302b0430ea),volume_type_id=752d62a5-61e7-4330-87c9-89302b0430ea)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Creating volume 2f22963d-19d4-43d9-9951-a8f0e38070af {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:56:33 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:56:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:33 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af 1073741824 Sep 17 23:56:33 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:34 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af 1073741824" returned: 0 in 0.409s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:34 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af Sep 17 23:56:34 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:34 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Attempting download of 9375aa43-47cc-42a9-b8af-7a05c3120154 ((None, [{'url': 'file:///opt/stack/data/glance/images/9375aa43-47cc-42a9-b8af-7a05c3120154', 'metadata': {}}])) to volume 2f22963d-19d4-43d9-9951-a8f0e38070af. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a26422-9a31-48ec-acd2-3e4371de42aa]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9375aa43-47cc-42a9-b8af-7a05c3120154_vcj_whpf {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:34 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9375aa43-47cc-42a9-b8af-7a05c3120154_vcj_whpf Sep 17 23:56:34 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:34 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9375aa43-47cc-42a9-b8af-7a05c3120154_vcj_whpf" returned: 0 in 0.338s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9375aa43-47cc-42a9-b8af-7a05c3120154_vcj_whpf {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:35 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9375aa43-47cc-42a9-b8af-7a05c3120154_vcj_whpf Sep 17 23:56:35 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:35 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9375aa43-47cc-42a9-b8af-7a05c3120154_vcj_whpf" returned: 1 in 0.327s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9375aa43-47cc-42a9-b8af-7a05c3120154_vcj_whpf' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bde4e0-8dda-4540-a729-814fbfd85664]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:35 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD Sep 17 23:56:35 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:35 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:35 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD Sep 17 23:56:35 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:35 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] 9375aa43-47cc-42a9-b8af-7a05c3120154 was raw, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:56:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:36 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af Sep 17 23:56:36 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:36 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af" returned: 0 in 0.447s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9375aa43-47cc-42a9-b8af-7a05c3120154_ny5jts8hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:56:36 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:36 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af 1G Sep 17 23:56:36 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:36 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af 1G" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Downloaded image 9375aa43-47cc-42a9-b8af-7a05c3120154 ((None, [{'url': 'file:///opt/stack/data/glance/images/9375aa43-47cc-42a9-b8af-7a05c3120154', 'metadata': {}}])) to volume 2f22963d-19d4-43d9-9951-a8f0e38070af successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Temporary image 9375aa43-47cc-42a9-b8af-7a05c3120154 for user 238f3a05aa3e45f48c8ddb5f7cd1f20e is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Marking volume 2f22963d-19d4-43d9-9951-a8f0e38070af as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Copying metadata from image 9375aa43-47cc-42a9-b8af-7a05c3120154 to 2f22963d-19d4-43d9-9951-a8f0e38070af. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Creating volume glance metadata for volume 2f22963d-19d4-43d9-9951-a8f0e38070af backed by image 9375aa43-47cc-42a9-b8af-7a05c3120154 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9375aa43-47cc-42a9-b8af-7a05c3120154', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ba4d3b4ec162a13d120857d8e7c7866b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc70b477-8907-4d06-8486-9cfae2ead13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f22963d-19d4-43d9-9951-a8f0e38070af', 'volume_size': 1, 'image_id': '9375aa43-47cc-42a9-b8af-7a05c3120154', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9375aa43-47cc-42a9-b8af-7a05c3120154', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba4d3b4ec162a13d120857d8e7c7866b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4adee0924dd846939029ebb6591a7299', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bc68ea1c36fd8174fc9d91815f112804a9e957a2080735cb06ac6f22a1e86dda845fa9270b71f08cf367e6bc1d587e561a7d6d28976e3ae8ae6e65cb4e28edb', 'id': '9375aa43-47cc-42a9-b8af-7a05c3120154', 'created_at': datetime.datetime(2026, 9, 17, 21, 56, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 56, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9375aa43-47cc-42a9-b8af-7a05c3120154/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4de0bc-be20-40fd-9dcb-04594f974893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Volume volume-2f22963d-19d4-43d9-9951-a8f0e38070af (2f22963d-19d4-43d9-9951-a8f0e38070af): created successfully Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4de0bc-be20-40fd-9dcb-04594f974893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Flow 'volume_create_manager' (0c182850-afc1-4e46-8bd0-6aeddce0687a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:56:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c50d9364-91b7-4c22-af48-53a0aaca7df3 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Created volume successfully. Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Acquiring lock "cinder-2f22963d-19d4-43d9-9951-a8f0e38070af-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "cinder-2f22963d-19d4-43d9-9951-a8f0e38070af-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Acquiring lock "cinder-quobyte-2f22963d-19d4-43d9-9951-a8f0e38070af" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "cinder-quobyte-2f22963d-19d4-43d9-9951-a8f0e38070af" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0ed8b0-0fb5-47b1-85a1-909f1945aaf4]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:37 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af Sep 17 23:56:37 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:37 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:37 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af Sep 17 23:56:37 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:38 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2f22963d-19d4-43d9-9951-a8f0e38070af" returned: 0 in 0.238s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "cinder-quobyte-2f22963d-19d4-43d9-9951-a8f0e38070af" released by "delete_volume" :: held 0.634s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:38 devstack cinder-volume[85956]: WARNING cinder.quota [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:56:38 devstack cinder-volume[85956]: WARNING cinder.quota [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Created reservations ['c8a3a2b8-05e9-4f49-91e0-60acda007d74', 'effd4310-6ce9-4029-96bc-7fd05406eeec', '89d4a1bb-7176-443e-b2e4-6909b4f93c34', '6b3735f2-8250-46e7-ac3a-85540c56146c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:38 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:56:38 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:38 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.234s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:56:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Deleted volume successfully. Sep 17 23:56:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e9847957-35be-4f76-b88f-3581d9d608c5 tempest-VolumeAndVolumeTypeFromImageTest-710988706 None] Lock "cinder-2f22963d-19d4-43d9-9951-a8f0e38070af-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:42 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:56:42 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:42 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.263s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Flow 'volume_create_manager' (71856ef9-c88b-4351-ab8e-71f0973b64c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1544d60-6d3c-47f6-b992-750454f274e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1544d60-6d3c-47f6-b992-750454f274e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-624779930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841d0b65-dcaa-4c60-a738-aceca3e86464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd719ced3864404ad2b0fe3732a27b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:56:42Z,use_quota=True,user_id='26ace2888cfa4395b8a0587bc20045bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73af59f-3de1-41eb-a18d-eb635717b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73af59f-3de1-41eb-a18d-eb635717b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f78350-7090-4f16-a8ed-387a97fbf777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f78350-7090-4f16-a8ed-387a97fbf777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841d0b65-dcaa-4c60-a738-aceca3e86464', 'volume_name': 'volume-841d0b65-dcaa-4c60-a738-aceca3e86464', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60cbaff-64a2-4415-941d-ad4d225be190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60cbaff-64a2-4415-941d-ad4d225be190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fefc634-38e5-47b8-978e-4b7e6d8a7aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:42 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Volume 841d0b65-dcaa-4c60-a738-aceca3e86464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841d0b65-dcaa-4c60-a738-aceca3e86464', 'volume_size': 1} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-624779930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841d0b65-dcaa-4c60-a738-aceca3e86464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd719ced3864404ad2b0fe3732a27b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:56:42Z,use_quota=True,user_id='26ace2888cfa4395b8a0587bc20045bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Creating volume 841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:56:42 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:56:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:42 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 1073741824 Sep 17 23:56:42 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:43 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 1073741824" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:43 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 Sep 17 23:56:43 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:43 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464" returned: 0 in 0.244s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fefc634-38e5-47b8-978e-4b7e6d8a7aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841d0b65-dcaa-4c60-a738-aceca3e86464', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdc6ae7-82ce-4f5a-af72-de369035fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:43 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Volume volume-841d0b65-dcaa-4c60-a738-aceca3e86464 (841d0b65-dcaa-4c60-a738-aceca3e86464): created successfully Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdc6ae7-82ce-4f5a-af72-de369035fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Flow 'volume_create_manager' (71856ef9-c88b-4351-ab8e-71f0973b64c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:56:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-76bb21d5-c691-4b29-8f43-f67cf040bae6 tempest-VolumeDependencyTests-858311461 None] Created volume successfully. Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Creating offline snapshot f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 of volume 841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfa7133-c0f2-4a18-ad2c-f31659e7799a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:43 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 Sep 17 23:56:43 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:44 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464" returned: 0 in 0.364s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:44 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 1G Sep 17 23:56:44 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:44 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 1G" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841d0b65-dcaa-4c60-a738-aceca3e86464 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:44 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841d0b65-dcaa-4c60-a738-aceca3e86464 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 Sep 17 23:56:44 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:44 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841d0b65-dcaa-4c60-a738-aceca3e86464 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" returned: 0 in 0.294s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:44 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 is being set with open permissions: ugo+rw Sep 17 23:56:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:44 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 Sep 17 23:56:44 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:45 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" returned: 0 in 0.243s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:45 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.info Sep 17 23:56:45 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:45 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.info" returned: 0 in 0.249s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:45 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.info is being set with open permissions: ugo+rw Sep 17 23:56:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:45 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.info Sep 17 23:56:45 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:45 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.info" returned: 0 in 0.243s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8ec01820-91e8-46ee-a9c8-33efba10c810 tempest-VolumeDependencyTests-858311461 None] Create snapshot completed successfully Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Flow 'volume_create_manager' (82f1efd2-d2ae-41a9-853e-1e765c1c5cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17042464-7f2b-4357-b861-af46582defe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17042464-7f2b-4357-b861-af46582defe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-559325122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9166740e-74da-4f80-a39d-3df196593ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd719ced3864404ad2b0fe3732a27b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f743dc9c-42ce-411f-bbc8-bcee58eb1ac9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:56:46Z,use_quota=True,user_id='26ace2888cfa4395b8a0587bc20045bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f41aa2-279d-491d-a1ae-d85edba643b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f41aa2-279d-491d-a1ae-d85edba643b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1eaff9-ebb7-4699-8970-53b8f013f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1eaff9-ebb7-4699-8970-53b8f013f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9166740e-74da-4f80-a39d-3df196593ba5', 'volume_name': 'volume-9166740e-74da-4f80-a39d-3df196593ba5', 'volume_size': 1, 'snapshot_id': 'f743dc9c-42ce-411f-bbc8-bcee58eb1ac9'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd87f14f-dbf3-4e62-a1ea-3e5bd8f02129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd87f14f-dbf3-4e62-a1ea-3e5bd8f02129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ec11ff-f815-4c12-9dd6-3c5b74e4d8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:46 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Volume 9166740e-74da-4f80-a39d-3df196593ba5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9166740e-74da-4f80-a39d-3df196593ba5', 'volume_size': 1, 'snapshot_id': 'f743dc9c-42ce-411f-bbc8-bcee58eb1ac9'} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-quobyte-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9-9166740e-74da-4f80-a39d-3df196593ba5" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9-9166740e-74da-4f80-a39d-3df196593ba5" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Creating volume 9166740e-74da-4f80-a39d-3df196593ba5 from snapshot f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-quobyte-9166740e-74da-4f80-a39d-3df196593ba5" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-9166740e-74da-4f80-a39d-3df196593ba5" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] snapshot: f743dc9c-42ce-411f-bbc8-bcee58eb1ac9, volume: 9166740e-74da-4f80-a39d-3df196593ba5, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0255b9ef-0a18-4ef4-a212-06388468a2f1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:46 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 Sep 17 23:56:46 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:46 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" returned: 0 in 0.381s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-841d0b65-dcaa-4c60-a738-aceca3e86464(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41868f5-b1ed-4b0d-be89-4b7286ef738e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:46 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 Sep 17 23:56:46 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:47 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464" returned: 0 in 0.356s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:56:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:56:47 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:56:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:47 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 Sep 17 23:56:47 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:53 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5" returned: 0 in 5.950s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:56:53 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Converted 1024.00 MB image at 172.05 MB/s Sep 17 23:56:53 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 is being set with open permissions: ugo+rw Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:53 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 Sep 17 23:56:53 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:53 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5" returned: 0 in 0.247s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-9166740e-74da-4f80-a39d-3df196593ba5" released by "_copy_volume_from_snapshot" :: held 7.015s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9-9166740e-74da-4f80-a39d-3df196593ba5" released by "_create_volume_from_snapshot" :: held 7.073s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.087s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ec11ff-f815-4c12-9dd6-3c5b74e4d8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9166740e-74da-4f80-a39d-3df196593ba5', 'volume_size': 1, 'snapshot_id': 'f743dc9c-42ce-411f-bbc8-bcee58eb1ac9'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd97497a-0986-4237-b28e-14a206bf14be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:56:53 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Volume volume-9166740e-74da-4f80-a39d-3df196593ba5 (9166740e-74da-4f80-a39d-3df196593ba5): created successfully Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd97497a-0986-4237-b28e-14a206bf14be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Flow 'volume_create_manager' (82f1efd2-d2ae-41a9-853e-1e765c1c5cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:56:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2829aab0-facf-451e-8e16-efa07d77d7a4 tempest-VolumeDependencyTests-858311461 None] Created volume successfully. Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Lock "cinder-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-quobyte-841d0b65-dcaa-4c60-a738-aceca3e86464" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-841d0b65-dcaa-4c60-a738-aceca3e86464" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-quobyte-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Deleting offline snapshot f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 of volume 841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] snapshot_file for this snap is: volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3604a-1063-465c-8d33-a8235b81342b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:53 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 Sep 17 23:56:53 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:54 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" returned: 0 in 0.348s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-841d0b65-dcaa-4c60-a738-aceca3e86464(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:56:54 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f07877-e22c-4269-95c2-47b71691b665]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:54 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 Sep 17 23:56:54 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:54 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464" returned: 0 in 0.536s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:54 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 Sep 17 23:56:54 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:55 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" returned: 0 in 0.329s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:55 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9 Sep 17 23:56:55 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:55 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464.f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" returned: 0 in 0.243s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9" released by "_delete_snapshot" :: held 1.554s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-841d0b65-dcaa-4c60-a738-aceca3e86464" released by "delete_snapshot" :: held 1.573s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Created reservations ['9b754484-94ff-4902-b2fd-a1801fe20bf3', '0546d520-5ae8-40b0-b9fd-77c0bc8fdc0d', '0351c0c2-578a-4d9f-b9dd-41588885baa0', 'f640e4c3-8dea-4f58-946e-68eca070dd15'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:56:55 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Delete snapshot completed successfully. Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-73679fe5-4448-452c-ad7e-13103867f6ec tempest-VolumeDependencyTests-858311461 None] Lock "cinder-f743dc9c-42ce-411f-bbc8-bcee58eb1ac9-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-841d0b65-dcaa-4c60-a738-aceca3e86464-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-841d0b65-dcaa-4c60-a738-aceca3e86464-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-quobyte-841d0b65-dcaa-4c60-a738-aceca3e86464" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-841d0b65-dcaa-4c60-a738-aceca3e86464" acquired by "delete_volume" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036bab2-33bc-4dff-992b-2edbd93c3706]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:56 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 Sep 17 23:56:56 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:56 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464" returned: 0 in 0.358s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:56 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464 Sep 17 23:56:56 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:56 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-841d0b65-dcaa-4c60-a738-aceca3e86464" returned: 0 in 0.248s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-841d0b65-dcaa-4c60-a738-aceca3e86464" released by "delete_volume" :: held 0.668s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Created reservations ['a814a86f-1f25-4b62-91f4-02e1add807b3', '19ed4ec4-8b3d-4d7c-9ce7-d1b022178503', 'ccf05c2f-20bb-464b-94de-113b416b8f01', 'eba9b873-fdc1-45e2-9396-6fb815e51687'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:56 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:56:56 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:57 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.241s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:56:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Deleted volume successfully. Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6699aab6-b9a1-4b81-9c13-098480eec0c9 tempest-VolumeDependencyTests-858311461 None] Lock "cinder-841d0b65-dcaa-4c60-a738-aceca3e86464-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-9166740e-74da-4f80-a39d-3df196593ba5-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Lock "cinder-9166740e-74da-4f80-a39d-3df196593ba5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Acquiring lock "cinder-quobyte-9166740e-74da-4f80-a39d-3df196593ba5" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-9166740e-74da-4f80-a39d-3df196593ba5" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9358c8-c320-488a-8efa-6e7b0b37dee2]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:57 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 Sep 17 23:56:57 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:57 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5" returned: 0 in 0.354s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:57 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5 Sep 17 23:56:57 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:57 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9166740e-74da-4f80-a39d-3df196593ba5" returned: 0 in 0.246s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Lock "cinder-quobyte-9166740e-74da-4f80-a39d-3df196593ba5" released by "delete_volume" :: held 0.642s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Created reservations ['c9e59407-c0c7-4824-b972-1f0e1402f3ee', '2e0a7580-be00-491b-8c40-c7f250fa3aed', '0d5618bd-8a3b-4b59-9f0e-0034fe4ea75c', '59ccfa81-ba17-48bb-ba7d-0830289aa97b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:56:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:56:57 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:56:57 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:56:58 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 17 23:56:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.237s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:56:58 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:56:58 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Deleted volume successfully. Sep 17 23:56:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8c076ba9-68cf-41a4-b088-4ee9b35d1afd tempest-VolumeDependencyTests-858311461 None] Lock "cinder-9166740e-74da-4f80-a39d-3df196593ba5-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Flow 'volume_create_manager' (bd9e8fd1-da72-47a7-b7fb-e675cbeef49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9802cb1b-2823-44e8-84c7-69f9c98dd1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9802cb1b-2823-44e8-84c7-69f9c98dd1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fb646b-e539-417b-85fb-77e79b774b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ab83d8db914e168e00ef643fb17703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:01Z,use_quota=True,user_id='b308987164a640c091311c249368c5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e4f242-55e9-4240-971c-28dd4751d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e4f242-55e9-4240-971c-28dd4751d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981ad948-084f-4c1a-b3e6-e0c806eeecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981ad948-084f-4c1a-b3e6-e0c806eeecc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fb646b-e539-417b-85fb-77e79b774b9a', 'volume_name': 'volume-b1fb646b-e539-417b-85fb-77e79b774b9a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf4b70-ef1e-438d-a8f4-72ed0242216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf4b70-ef1e-438d-a8f4-72ed0242216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ebd75b-d409-4dd3-b77d-538056166844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:00 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Volume b1fb646b-e539-417b-85fb-77e79b774b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fb646b-e539-417b-85fb-77e79b774b9a', 'volume_size': 1} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fb646b-e539-417b-85fb-77e79b774b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ab83d8db914e168e00ef643fb17703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:01Z,use_quota=True,user_id='b308987164a640c091311c249368c5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Creating volume b1fb646b-e539-417b-85fb-77e79b774b9a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:00 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:01 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a 1073741824 Sep 17 23:57:01 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:01 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a 1073741824" returned: 0 in 0.397s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:01 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a Sep 17 23:57:01 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:01 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a" returned: 0 in 0.243s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ebd75b-d409-4dd3-b77d-538056166844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fb646b-e539-417b-85fb-77e79b774b9a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9991c97-2eca-4617-96d0-d3cc37570898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Volume volume-b1fb646b-e539-417b-85fb-77e79b774b9a (b1fb646b-e539-417b-85fb-77e79b774b9a): created successfully Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9991c97-2eca-4617-96d0-d3cc37570898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Flow 'volume_create_manager' (bd9e8fd1-da72-47a7-b7fb-e675cbeef49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-cbdbcfca-2b3c-412a-821a-9532585ddf64 tempest-CinderUnicodeTest-1703562109 None] Created volume successfully. Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Flow 'volume_create_manager' (c91adfa1-e37a-48c2-a8d7-d60cd7258d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b66a62-27cc-475a-b0ea-e94f9215650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b66a62-27cc-475a-b0ea-e94f9215650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-778436197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c404fb13-b566-4d95-b2dd-f05c54e14c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ab83d8db914e168e00ef643fb17703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:02Z,use_quota=True,user_id='b308987164a640c091311c249368c5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917f706d-af19-4aff-9719-0700734b3047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917f706d-af19-4aff-9719-0700734b3047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63792ebe-1bdd-4816-b431-382b925f0083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63792ebe-1bdd-4816-b431-382b925f0083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c404fb13-b566-4d95-b2dd-f05c54e14c47', 'volume_name': 'volume-c404fb13-b566-4d95-b2dd-f05c54e14c47', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3f4775-dcad-44bb-99d3-c4a1555be126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3f4775-dcad-44bb-99d3-c4a1555be126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e1ffaf-c6cf-4182-b316-9858a2db63dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:02 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Volume c404fb13-b566-4d95-b2dd-f05c54e14c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c404fb13-b566-4d95-b2dd-f05c54e14c47', 'volume_size': 1} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-778436197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c404fb13-b566-4d95-b2dd-f05c54e14c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ab83d8db914e168e00ef643fb17703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:02Z,use_quota=True,user_id='b308987164a640c091311c249368c5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Creating volume c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:02 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:02 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 1073741824 Sep 17 23:57:02 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:02 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 1073741824" returned: 0 in 0.423s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:02 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 Sep 17 23:57:02 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:03 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47" returned: 0 in 0.243s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e1ffaf-c6cf-4182-b316-9858a2db63dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c404fb13-b566-4d95-b2dd-f05c54e14c47', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366910d-e671-4cc1-ae7c-d008458524e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:03 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Volume volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 (c404fb13-b566-4d95-b2dd-f05c54e14c47): created successfully Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366910d-e671-4cc1-ae7c-d008458524e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Flow 'volume_create_manager' (c91adfa1-e37a-48c2-a8d7-d60cd7258d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:03 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-130688b2-74a9-43ec-9016-45658ae6335c tempest-CinderUnicodeTest-1703562109 None] Created volume successfully. Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Creating offline snapshot a221ee7b-0eba-4bbe-9999-61bf213d8bcd of volume c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98ef23a-8b99-4a08-9f7e-0329987d59b2]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:03 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 Sep 17 23:57:03 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:03 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47" returned: 0 in 0.363s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:04 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd 1G Sep 17 23:57:04 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:04 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd 1G" returned: 0 in 0.390s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:04 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd Sep 17 23:57:04 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:04 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd" returned: 0 in 0.288s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:04 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd is being set with open permissions: ugo+rw Sep 17 23:57:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:04 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd Sep 17 23:57:04 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:04 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd" returned: 0 in 0.241s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:04 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.info Sep 17 23:57:04 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:05 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.info" returned: 0 in 0.257s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:05 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.info is being set with open permissions: ugo+rw Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:05 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.info Sep 17 23:57:05 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:05 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.info" returned: 0 in 0.235s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a56f9ebb-2d75-43de-9ca6-1521ac4de684 tempest-CinderUnicodeTest-1703562109 None] Create snapshot completed successfully Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "cinder-a221ee7b-0eba-4bbe-9999-61bf213d8bcd-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-a221ee7b-0eba-4bbe-9999-61bf213d8bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "cinder-quobyte-c404fb13-b566-4d95-b2dd-f05c54e14c47" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-c404fb13-b566-4d95-b2dd-f05c54e14c47" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "cinder-quobyte-a221ee7b-0eba-4bbe-9999-61bf213d8bcd" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-a221ee7b-0eba-4bbe-9999-61bf213d8bcd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Deleting offline snapshot a221ee7b-0eba-4bbe-9999-61bf213d8bcd of volume c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] snapshot_file for this snap is: volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0177536d-c344-4d3b-a5d2-2af652adf023]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:05 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd Sep 17 23:57:05 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:06 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd" returned: 0 in 0.357s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c404fb13-b566-4d95-b2dd-f05c54e14c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5fd0af-6641-4691-8d6a-14d4fe4ccc80]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:06 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 Sep 17 23:57:06 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:06 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47" returned: 0 in 0.351s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:06 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd Sep 17 23:57:06 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:06 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd" returned: 0 in 0.342s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:06 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd Sep 17 23:57:06 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:07 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47.a221ee7b-0eba-4bbe-9999-61bf213d8bcd" returned: 0 in 0.244s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-a221ee7b-0eba-4bbe-9999-61bf213d8bcd" released by "_delete_snapshot" :: held 1.396s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-c404fb13-b566-4d95-b2dd-f05c54e14c47" released by "delete_snapshot" :: held 1.416s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Created reservations ['b9edb3d7-e4d0-4c6b-b586-ace7e52244a8', 'eede6b38-1b10-4a56-b235-919cfe9665fa', '7ba11de0-5a09-4100-bd24-df25c961f1a3', '25c47304-3d56-4299-af25-f1e31e634b8d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:07 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Delete snapshot completed successfully. Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90ddcd80-7030-4165-b95d-052d2263a618 tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-a221ee7b-0eba-4bbe-9999-61bf213d8bcd-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "cinder-c404fb13-b566-4d95-b2dd-f05c54e14c47-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-c404fb13-b566-4d95-b2dd-f05c54e14c47-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "cinder-quobyte-c404fb13-b566-4d95-b2dd-f05c54e14c47" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-c404fb13-b566-4d95-b2dd-f05c54e14c47" acquired by "delete_volume" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[128cce88-ff73-4404-b716-914e1fe94d24]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:08 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 Sep 17 23:57:08 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:08 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47" returned: 0 in 0.349s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:08 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47 Sep 17 23:57:08 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:08 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c404fb13-b566-4d95-b2dd-f05c54e14c47" returned: 0 in 0.239s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-c404fb13-b566-4d95-b2dd-f05c54e14c47" released by "delete_volume" :: held 0.653s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Created reservations ['68c5a144-4547-42ac-ba45-d674cbcb88f2', '5bfb4866-832e-4bd4-94a8-79c5c3024e95', 'cab7af1d-2129-47e1-8326-ccc23b1761f8', 'f8de81bb-4723-432c-b66f-1f01c6ca5a64'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:08 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:08 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:08 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.240s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Deleted volume successfully. Sep 17 23:57:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be3bf015-ef7e-4a04-832f-22314dc31b4d tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-c404fb13-b566-4d95-b2dd-f05c54e14c47-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "cinder-b1fb646b-e539-417b-85fb-77e79b774b9a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-b1fb646b-e539-417b-85fb-77e79b774b9a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "cinder-quobyte-b1fb646b-e539-417b-85fb-77e79b774b9a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-b1fb646b-e539-417b-85fb-77e79b774b9a" acquired by "delete_volume" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a90144-e97e-4e17-b77b-cef148c8462f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:09 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a Sep 17 23:57:09 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:09 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a" returned: 0 in 0.358s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:09 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a Sep 17 23:57:09 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:09 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b1fb646b-e539-417b-85fb-77e79b774b9a" returned: 0 in 0.242s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-quobyte-b1fb646b-e539-417b-85fb-77e79b774b9a" released by "delete_volume" :: held 0.639s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Created reservations ['9998e6a4-d732-483b-a2f9-e907c6655b6d', '2556bd9f-5a19-4266-b951-891c8e53633d', '8a305642-05e8-4c8f-8beb-399d1dfe406a', '5ea2608f-0f2c-464e-ad55-1fec42e2cbda'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:09 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:09 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:10 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.248s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:10 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Deleted volume successfully. Sep 17 23:57:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-94e35e43-e0a7-44aa-ad12-a0eaec14b7ad tempest-CinderUnicodeTest-1703562109 None] Lock "cinder-b1fb646b-e539-417b-85fb-77e79b774b9a-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Flow 'volume_create_manager' (5d301ae8-22af-4354-89d6-9ad3bf5a1027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281bea61-e364-424c-ae20-e1224d5a8aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281bea61-e364-424c-ae20-e1224d5a8aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185677350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a794a01d-2586-458c-8382-873f1b4cc115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6f39271f041989751195bd6eb3c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:13Z,use_quota=True,user_id='7cbd397912c341ab895d5c681f77c596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5946c427-ceca-4547-b3dc-5e0dbb841a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5946c427-ceca-4547-b3dc-5e0dbb841a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5726453-0e3e-4adf-bf32-bf18af7c0b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5726453-0e3e-4adf-bf32-bf18af7c0b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a794a01d-2586-458c-8382-873f1b4cc115', 'volume_name': 'volume-a794a01d-2586-458c-8382-873f1b4cc115', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c55bbe-17d3-41df-a5bd-0c101314a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c55bbe-17d3-41df-a5bd-0c101314a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666114ce-0a16-4fdc-ba09-da9101349b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Volume a794a01d-2586-458c-8382-873f1b4cc115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a794a01d-2586-458c-8382-873f1b4cc115', 'volume_size': 1} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185677350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a794a01d-2586-458c-8382-873f1b4cc115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6f39271f041989751195bd6eb3c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:13Z,use_quota=True,user_id='7cbd397912c341ab895d5c681f77c596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Creating volume a794a01d-2586-458c-8382-873f1b4cc115 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:13 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:13 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 1073741824 Sep 17 23:57:13 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:13 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 1073741824" returned: 0 in 0.429s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:13 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 Sep 17 23:57:13 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:14 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115" returned: 0 in 0.245s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666114ce-0a16-4fdc-ba09-da9101349b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a794a01d-2586-458c-8382-873f1b4cc115', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687cc107-91a6-4764-aa25-55124cb56321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:14 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Volume volume-a794a01d-2586-458c-8382-873f1b4cc115 (a794a01d-2586-458c-8382-873f1b4cc115): created successfully Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687cc107-91a6-4764-aa25-55124cb56321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Flow 'volume_create_manager' (5d301ae8-22af-4354-89d6-9ad3bf5a1027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-849e3395-2a5a-4a51-80ee-64e43ab6fc57 tempest-ProjectReaderTests-1103569349 None] Created volume successfully. Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "cinder-a794a01d-2586-458c-8382-873f1b4cc115-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-a794a01d-2586-458c-8382-873f1b4cc115-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "cinder-quobyte-a794a01d-2586-458c-8382-873f1b4cc115" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-quobyte-a794a01d-2586-458c-8382-873f1b4cc115" acquired by "delete_volume" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e5adf-2705-480d-8e0a-f624de51c6af]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:14 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 Sep 17 23:57:14 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:14 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115" returned: 0 in 0.363s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:14 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115 Sep 17 23:57:14 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:15 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a794a01d-2586-458c-8382-873f1b4cc115" returned: 0 in 0.256s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-quobyte-a794a01d-2586-458c-8382-873f1b4cc115" released by "delete_volume" :: held 0.661s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Created reservations ['37ea6ab6-033a-4aec-b10e-1b5e9830b5a5', 'f544de77-0b78-4137-a2be-2ea7361c6373', 'b9f2a06a-dbef-4735-88aa-8ffe402ae0f7', '7401c259-5481-4149-b77c-5632db271a9d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:15 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:15 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:15 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.240s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Deleted volume successfully. Sep 17 23:57:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08d1d37f-4dd3-4fc7-940a-86b1f69f0e71 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-a794a01d-2586-458c-8382-873f1b4cc115-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Flow 'volume_create_manager' (1f9a407d-2abc-4e7a-9e61-f27c3a84cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f26cca-11e1-44df-9837-3a25eac557eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f26cca-11e1-44df-9837-3a25eac557eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669128184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34988087-8a58-4558-ba3d-66c56ad22478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6f39271f041989751195bd6eb3c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:16Z,use_quota=True,user_id='7cbd397912c341ab895d5c681f77c596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf63c985-7005-4501-8e9c-5c797e2d037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf63c985-7005-4501-8e9c-5c797e2d037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783e1eb7-976b-456d-b992-9597117a87a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783e1eb7-976b-456d-b992-9597117a87a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34988087-8a58-4558-ba3d-66c56ad22478', 'volume_name': 'volume-34988087-8a58-4558-ba3d-66c56ad22478', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb5dfe1-4465-45bf-9796-ae2bd368c04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb5dfe1-4465-45bf-9796-ae2bd368c04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1df8f4-88ba-4c4e-a61b-a5523e644285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:16 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Volume 34988087-8a58-4558-ba3d-66c56ad22478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34988087-8a58-4558-ba3d-66c56ad22478', 'volume_size': 1} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669128184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34988087-8a58-4558-ba3d-66c56ad22478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6f39271f041989751195bd6eb3c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:16Z,use_quota=True,user_id='7cbd397912c341ab895d5c681f77c596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Creating volume 34988087-8a58-4558-ba3d-66c56ad22478 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:16 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:16 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 1073741824 Sep 17 23:57:16 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:16 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 1073741824" returned: 0 in 0.399s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:16 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 Sep 17 23:57:16 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:16 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478" returned: 0 in 0.240s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1df8f4-88ba-4c4e-a61b-a5523e644285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34988087-8a58-4558-ba3d-66c56ad22478', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01552b66-4407-4303-baf4-7f996047931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:16 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Volume volume-34988087-8a58-4558-ba3d-66c56ad22478 (34988087-8a58-4558-ba3d-66c56ad22478): created successfully Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01552b66-4407-4303-baf4-7f996047931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Flow 'volume_create_manager' (1f9a407d-2abc-4e7a-9e61-f27c3a84cd31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-bdd053eb-72f3-4086-bfe5-2001f1a3617f tempest-ProjectReaderTests-1103569349 None] Created volume successfully. Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "cinder-34988087-8a58-4558-ba3d-66c56ad22478-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-34988087-8a58-4558-ba3d-66c56ad22478-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "cinder-quobyte-34988087-8a58-4558-ba3d-66c56ad22478" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-quobyte-34988087-8a58-4558-ba3d-66c56ad22478" acquired by "delete_volume" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad729585-ed2b-44b3-ad2f-e55fdc69c50b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:17 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 Sep 17 23:57:17 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:17 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478" returned: 0 in 0.347s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:17 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478 Sep 17 23:57:17 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:17 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34988087-8a58-4558-ba3d-66c56ad22478" returned: 0 in 0.241s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-quobyte-34988087-8a58-4558-ba3d-66c56ad22478" released by "delete_volume" :: held 0.631s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Created reservations ['34f345a6-4aa6-4763-b755-3d566dcb2ad8', 'b4cbc4f2-bd4f-49a9-88a0-00e79ab3feae', 'ed425549-b764-40c9-b1d8-cf001f0242a9', 'c663642d-830d-454d-b361-e5aa3a5312c8'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:17 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:17 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:18 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.236s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:18 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:18 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Deleted volume successfully. Sep 17 23:57:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-98fddaaa-a304-40c0-90dc-b59ae3a63c86 tempest-ProjectReaderTests-1103569349 None] Lock "cinder-34988087-8a58-4558-ba3d-66c56ad22478-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:27 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=75,cinder:INSERT=27,cinder:UPDATE=88,cinder:DELETE=9 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:57:28 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=97,cinder:INSERT=28,cinder:SELECT=74,cinder:DELETE=7 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Flow 'volume_create_manager' (586d93a7-cd75-437e-89d1-d845f09e8798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2984b975-29d6-4a70-9a4b-4bcca9ec4e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2984b975-29d6-4a70-9a4b-4bcca9ec4e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-568731918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd25cce-65d8-4dba-8617-fd4edb44cd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7948133fd7746e4bb337d14f8c526a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:34Z,use_quota=True,user_id='fe70b487881348d99bd3acad2e3213d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0829acd4-6503-45c0-b655-d44f83650e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0829acd4-6503-45c0-b655-d44f83650e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3a7df1-9a03-45f6-957e-8a9c4bfdc29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3a7df1-9a03-45f6-957e-8a9c4bfdc29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd25cce-65d8-4dba-8617-fd4edb44cd19', 'volume_name': 'volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5083152b-49d0-4d77-af0b-e27334300eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5083152b-49d0-4d77-af0b-e27334300eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3eaa61-52fa-4506-af90-33b078395294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Volume 3cd25cce-65d8-4dba-8617-fd4edb44cd19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19', 'volume_size': 1} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-568731918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd25cce-65d8-4dba-8617-fd4edb44cd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7948133fd7746e4bb337d14f8c526a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:34Z,use_quota=True,user_id='fe70b487881348d99bd3acad2e3213d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Creating volume 3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:34 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:34 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 1073741824 Sep 17 23:57:34 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (4ea82527-e198-4d09-bc56-9887fd86e431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba46b29-5d58-4c4b-9432-31545e2e83e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba46b29-5d58-4c4b-9432-31545e2e83e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1866709909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e211985-b297-474d-b4b4-0055cee8d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:35Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cbd4ba-9f4a-4eeb-8985-7f340d24e75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cbd4ba-9f4a-4eeb-8985-7f340d24e75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc63074-4ee4-4546-8447-b3a6dcf24e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc63074-4ee4-4546-8447-b3a6dcf24e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e211985-b297-474d-b4b4-0055cee8d8ba', 'volume_name': 'volume-4e211985-b297-474d-b4b4-0055cee8d8ba', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0113a8b-d25e-4b8d-ad52-05f1f5f246f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0113a8b-d25e-4b8d-ad52-05f1f5f246f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbb2db8-4fbb-4b03-80fe-9e3e6b40eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:34 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Volume 4e211985-b297-474d-b4b4-0055cee8d8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e211985-b297-474d-b4b4-0055cee8d8ba', 'volume_size': 1} Sep 17 23:57:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:35 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 1073741824" returned: 0 in 0.684s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (3c2eaa3e-202f-4b58-af34-3fa26b4bdbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63feeff6-682a-4a3e-9c7e-202ade9640b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63feeff6-682a-4a3e-9c7e-202ade9640b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979800128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10b6a5c-f553-4234-91af-98afc8154ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:35Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19804f4a-190a-4acb-8f45-f5c1865ccc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19804f4a-190a-4acb-8f45-f5c1865ccc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba624c3-673c-4af2-b9c4-682363d44ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba624c3-673c-4af2-b9c4-682363d44ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10b6a5c-f553-4234-91af-98afc8154ca3', 'volume_name': 'volume-e10b6a5c-f553-4234-91af-98afc8154ca3', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a60c0e-73c5-46c0-8798-446c6a5b1f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a60c0e-73c5-46c0-8798-446c6a5b1f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5676e4-6c68-478d-8572-8ec3f0c37b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume e10b6a5c-f553-4234-91af-98afc8154ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10b6a5c-f553-4234-91af-98afc8154ca3', 'volume_size': 1} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:35 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 Sep 17 23:57:35 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (c26222b8-4ba4-4ce2-9c71-9bfa29d68391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83517c98-b632-4caf-bc32-996a64bede84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83517c98-b632-4caf-bc32-996a64bede84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421742140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bfb079-752d-4cad-b134-e4aecaddbe89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:35Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbaf914-0a48-470e-b6c9-5e0397bb7e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbaf914-0a48-470e-b6c9-5e0397bb7e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036a66f7-59bb-4858-a1b5-133f156968d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036a66f7-59bb-4858-a1b5-133f156968d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81bfb079-752d-4cad-b134-e4aecaddbe89', 'volume_name': 'volume-81bfb079-752d-4cad-b134-e4aecaddbe89', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94927b1d-eac8-4feb-8380-dad4245ee4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94927b1d-eac8-4feb-8380-dad4245ee4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd351ec-0d16-44fe-b4e3-87d243c1f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Volume 81bfb079-752d-4cad-b134-e4aecaddbe89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81bfb079-752d-4cad-b134-e4aecaddbe89', 'volume_size': 1} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (d6692d73-1a9c-42a8-abdd-59c6d3075121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c181be38-5016-4b7d-8dae-f7f8fbfb3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c181be38-5016-4b7d-8dae-f7f8fbfb3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337794584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf2669b-6b3d-4607-86c6-25f8ac68c712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:36Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2398c-0918-4586-9170-4b44cb2780dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2398c-0918-4586-9170-4b44cb2780dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9c8b29-17da-457c-a466-71d184bafd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9c8b29-17da-457c-a466-71d184bafd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf2669b-6b3d-4607-86c6-25f8ac68c712', 'volume_name': 'volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993b9bf1-7438-4df8-ab13-dbf8c12a81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993b9bf1-7438-4df8-ab13-dbf8c12a81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5ba7db-c8f2-4db9-b6d6-310e5aa45a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Volume 9cf2669b-6b3d-4607-86c6-25f8ac68c712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712', 'volume_size': 1} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:35 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19" returned: 0 in 0.418s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1866709909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e211985-b297-474d-b4b4-0055cee8d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:35Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Creating volume 4e211985-b297-474d-b4b4-0055cee8d8ba {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:35 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3eaa61-52fa-4506-af90-33b078395294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:35 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba 1073741824 Sep 17 23:57:35 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce03d09-91d2-4a67-aac6-124d4093ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:35 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Volume volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 (3cd25cce-65d8-4dba-8617-fd4edb44cd19): created successfully Sep 17 23:57:35 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce03d09-91d2-4a67-aac6-124d4093ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Flow 'volume_create_manager' (586d93a7-cd75-437e-89d1-d845f09e8798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:36 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c597a2f6-b6e1-4782-8c2c-03b09065eb2c tempest-VolumeDependencyTests-497422822 None] Created volume successfully. Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (81cdf10d-4304-42bc-9aaf-4ab3489a35ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394efd88-7260-47b8-be48-aaf74e395231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394efd88-7260-47b8-be48-aaf74e395231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701331101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25a1019-698c-4f8e-a15e-4405095b636d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:36Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34fb450-54a7-4575-bdbc-c8228bec196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34fb450-54a7-4575-bdbc-c8228bec196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5912b2-cb03-4301-8738-f25f02b9f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5912b2-cb03-4301-8738-f25f02b9f06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25a1019-698c-4f8e-a15e-4405095b636d', 'volume_name': 'volume-c25a1019-698c-4f8e-a15e-4405095b636d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6920285f-0dda-43bf-9e6f-f6b2ae078718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6920285f-0dda-43bf-9e6f-f6b2ae078718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1f3430-d991-480f-a8f6-4784392ba0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Volume c25a1019-698c-4f8e-a15e-4405095b636d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25a1019-698c-4f8e-a15e-4405095b636d', 'volume_size': 1} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:36 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba 1073741824" returned: 0 in 0.574s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (7638899f-4f03-4bf9-957c-3515dd06e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92db91a3-44c9-4e95-ba6e-afec802cfaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92db91a3-44c9-4e95-ba6e-afec802cfaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823541598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:36Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305955f8-46ec-4cbd-ae49-5e556428e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305955f8-46ec-4cbd-ae49-5e556428e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e90e20-29b9-45a5-93d9-e03500d18084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e90e20-29b9-45a5-93d9-e03500d18084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d', 'volume_name': 'volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496132bd-6fe1-4cd7-bfeb-263281b17e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496132bd-6fe1-4cd7-bfeb-263281b17e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e14130d-acae-422b-865f-62efb91089bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Volume 2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d', 'volume_size': 1} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:36 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba Sep 17 23:57:36 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:36 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba" returned: 0 in 0.288s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.467s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979800128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10b6a5c-f553-4234-91af-98afc8154ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:35Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Creating volume e10b6a5c-f553-4234-91af-98afc8154ca3 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:36 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbb2db8-4fbb-4b03-80fe-9e3e6b40eff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e211985-b297-474d-b4b4-0055cee8d8ba', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 1073741824 Sep 17 23:57:36 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc325c3-57db-4f2d-859a-0c0ed6b7380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:36 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Volume volume-4e211985-b297-474d-b4b4-0055cee8d8ba (4e211985-b297-474d-b4b4-0055cee8d8ba): created successfully Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc325c3-57db-4f2d-859a-0c0ed6b7380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:36 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (4ea82527-e198-4d09-bc56-9887fd86e431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1ebe4464-1355-4c3d-845f-2e04b858ab80 tempest-CreateVolumesFromImageTest-1754757320 None] Created volume successfully. Sep 17 23:57:37 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 1073741824" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:37 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 Sep 17 23:57:37 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:37 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3" returned: 0 in 0.254s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421742140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bfb079-752d-4cad-b134-e4aecaddbe89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:35Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Creating volume 81bfb079-752d-4cad-b134-e4aecaddbe89 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:37 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5676e4-6c68-478d-8572-8ec3f0c37b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10b6a5c-f553-4234-91af-98afc8154ca3', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:37 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 1073741824 Sep 17 23:57:37 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2b1529-d23d-4776-8e03-c42b9a849664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:37 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume volume-e10b6a5c-f553-4234-91af-98afc8154ca3 (e10b6a5c-f553-4234-91af-98afc8154ca3): created successfully Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2b1529-d23d-4776-8e03-c42b9a849664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:37 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (3c2eaa3e-202f-4b58-af34-3fa26b4bdbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4f2bc7b4-bdea-4787-8787-fd44d4765db0 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created volume successfully. Sep 17 23:57:38 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 1073741824" returned: 0 in 0.454s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:38 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 Sep 17 23:57:38 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:38 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89" returned: 0 in 0.253s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.581s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337794584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf2669b-6b3d-4607-86c6-25f8ac68c712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:36Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Creating volume 9cf2669b-6b3d-4607-86c6-25f8ac68c712 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:38 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd351ec-0d16-44fe-b4e3-87d243c1f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81bfb079-752d-4cad-b134-e4aecaddbe89', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20baaa7f-c552-4c2b-9257-6444a5fd3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:38 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 1073741824 Sep 17 23:57:38 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:38 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Volume volume-81bfb079-752d-4cad-b134-e4aecaddbe89 (81bfb079-752d-4cad-b134-e4aecaddbe89): created successfully Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20baaa7f-c552-4c2b-9257-6444a5fd3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (c26222b8-4ba4-4ce2-9c71-9bfa29d68391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-06fdff40-f6ff-4cc2-a1a2-4c1d817c0c23 tempest-CreateVolumesFromImageTest-1754757320 None] Created volume successfully. Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Flow 'volume_create_manager' (ed99a9c1-2d5e-4256-a268-9003e70a419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cc4e4a-dd7a-4dc7-b9c5-0a6618d3950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cc4e4a-dd7a-4dc7-b9c5-0a6618d3950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e62d36853354849972def20735e77ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:39Z,use_quota=True,user_id='b579fae45f624cb0b2b0098a0b984c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c513cc84-d22a-4a1c-9466-3b513bbcbc94),volume_type_id=c513cc84-d22a-4a1c-9466-3b513bbcbc94)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deba715d-b90e-4ba3-91f4-9936ccd838ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deba715d-b90e-4ba3-91f4-9936ccd838ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978d7c03-d0d9-4f7f-88dc-cdfcf5d4dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (386dc57b-7d19-4f1c-883d-989859cfa757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8f3b88-3269-406f-92d2-65c5178fec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8f3b88-3269-406f-92d2-65c5178fec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1944689035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c897b124-afd7-463d-9ac8-c1a2eb183cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:39Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577e5a58-5acc-468c-86c8-8642f90f2009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577e5a58-5acc-468c-86c8-8642f90f2009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba58f06b-6487-4eec-9a40-9c7a517794e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba58f06b-6487-4eec-9a40-9c7a517794e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c897b124-afd7-463d-9ac8-c1a2eb183cac', 'volume_name': 'volume-c897b124-afd7-463d-9ac8-c1a2eb183cac', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed95ef7-a847-4139-8e01-ef2dc58b708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed95ef7-a847-4139-8e01-ef2dc58b708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7149f60e-a569-41c8-9695-81a1abd8504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume c897b124-afd7-463d-9ac8-c1a2eb183cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c897b124-afd7-463d-9ac8-c1a2eb183cac', 'volume_size': 1} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:39 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 1073741824" returned: 0 in 0.670s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:39 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 Sep 17 23:57:39 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (07b30a1c-94fb-4edf-b77e-d889881a2319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478ed911-dcd9-4618-aeaa-06851b1a2aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478ed911-dcd9-4618-aeaa-06851b1a2aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357194159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2734126-b73c-41f1-b61f-1be584afdc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:39Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b5523b-3a71-4e5c-8062-cac15c5204c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b5523b-3a71-4e5c-8062-cac15c5204c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b2e25e-c2bc-46b8-b52d-b54eb57858ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b2e25e-c2bc-46b8-b52d-b54eb57858ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2734126-b73c-41f1-b61f-1be584afdc35', 'volume_name': 'volume-d2734126-b73c-41f1-b61f-1be584afdc35', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e26a021-001c-4113-8a4d-560a8e788233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e26a021-001c-4113-8a4d-560a8e788233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b2cfce-fad7-4daa-805b-310ead551f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume d2734126-b73c-41f1-b61f-1be584afdc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2734126-b73c-41f1-b61f-1be584afdc35', 'volume_size': 1} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978d7c03-d0d9-4f7f-88dc-cdfcf5d4dace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f', 'volume_name': 'volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f', 'volume_size': 1, 'image_id': 'b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78883878e8b8caaaee9128be576567bc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e62d36853354849972def20735e77ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dffc8d7a249e060b04c1d4c0418d7c8af4e5799560e79437fa50353faaaa6220e5cfca73a5057806d1c6f66f3f3ce4d313c2b5c517ea7c0f9fd33d8b3b180d88', 'id': 'b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'created_at': datetime.datetime(2026, 9, 17, 21, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a81c3a0-ff5c-4548-b306-05e68323b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a81c3a0-ff5c-4548-b306-05e68323b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc559780-3055-48f2-84c4-23b54d76c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Volume 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f', 'volume_size': 1, 'image_id': 'b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78883878e8b8caaaee9128be576567bc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e62d36853354849972def20735e77ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dffc8d7a249e060b04c1d4c0418d7c8af4e5799560e79437fa50353faaaa6220e5cfca73a5057806d1c6f66f3f3ce4d313c2b5c517ea7c0f9fd33d8b3b180d88', 'id': 'b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'created_at': datetime.datetime(2026, 9, 17, 21, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Trying to clone 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f from image b628dba4-29ed-48ea-b32a-1895d9fce8d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.274s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701331101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25a1019-698c-4f8e-a15e-4405095b636d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:36Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Creating volume c25a1019-698c-4f8e-a15e-4405095b636d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5ba7db-c8f2-4db9-b6d6-310e5aa45a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef185a6-bd07-4fb9-a861-dffc0f7aa52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d 1073741824 Sep 17 23:57:39 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Volume volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 (9cf2669b-6b3d-4607-86c6-25f8ac68c712): created successfully Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef185a6-bd07-4fb9-a861-dffc0f7aa52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (d6692d73-1a9c-42a8-abdd-59c6d3075121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Image download 0.00 MB at 0.00 MB/s Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-229185e5-7f1a-431f-a16b-28205554ccec tempest-CreateVolumesFromImageTest-1754757320 None] Created volume successfully. Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d04a4-50a6-44e5-accb-ce96c1cde468]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (52e7d97c-bdf2-4428-ab98-f4c35191cdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b21e47a-ce2d-4424-9fd1-a8efc2347f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b21e47a-ce2d-4424-9fd1-a8efc2347f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915198066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6afc9da-1d1e-4342-b96b-f1c026d62f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:40Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bbd9f7-a7a2-45b2-bf5b-8ec24097fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bbd9f7-a7a2-45b2-bf5b-8ec24097fd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b42311c-0fc9-4e14-abf6-cc90cbc1926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b42311c-0fc9-4e14-abf6-cc90cbc1926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6afc9da-1d1e-4342-b96b-f1c026d62f21', 'volume_name': 'volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38907413-9967-4a73-b074-9e53c25557f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38907413-9967-4a73-b074-9e53c25557f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b881b938-a634-4e76-83c7-8f10e725a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume e6afc9da-1d1e-4342-b96b-f1c026d62f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21', 'volume_size': 1} Sep 17 23:57:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:39 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD Sep 17 23:57:39 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:40 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d 1073741824" returned: 0 in 0.637s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:40 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:40 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d Sep 17 23:57:40 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:40 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD Sep 17 23:57:40 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (35154b75-aa46-4a4d-8088-d5bcb8eedd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2098b6be-2358-43b8-8565-5609387787f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2098b6be-2358-43b8-8565-5609387787f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320043617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06a69fc-6cf3-4808-aa62-7afffb8171e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:40Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86d1a3d-e355-465f-8e6e-831b664576e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86d1a3d-e355-465f-8e6e-831b664576e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894218d4-7da9-4cea-ac51-7e677cb34716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894218d4-7da9-4cea-ac51-7e677cb34716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06a69fc-6cf3-4808-aa62-7afffb8171e1', 'volume_name': 'volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa2a8e9-409e-497f-9b67-f1a6b5491047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa2a8e9-409e-497f-9b67-f1a6b5491047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7c5cfd-8a40-4ef9-b91a-8b469232cd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume d06a69fc-6cf3-4808-aa62-7afffb8171e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1', 'volume_size': 1} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:40 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d" returned: 0 in 0.277s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.848s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823541598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc3b21f834b446b2952ef82459a325b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:36Z,use_quota=True,user_id='13a094df560645269d121b2927b5c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Creating volume 2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:40 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1f3430-d991-480f-a8f6-4784392ba0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25a1019-698c-4f8e-a15e-4405095b636d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4b074b-ed27-405e-be6e-c7548e12df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d 1073741824 Sep 17 23:57:40 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Volume volume-c25a1019-698c-4f8e-a15e-4405095b636d (c25a1019-698c-4f8e-a15e-4405095b636d): created successfully Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4b074b-ed27-405e-be6e-c7548e12df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (81cdf10d-4304-42bc-9aaf-4ab3489a35ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:40 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ce6b793f-06cd-4108-b599-572f22a627b2 tempest-CreateVolumesFromImageTest-1754757320 None] Created volume successfully. Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Temporary image b628dba4-29ed-48ea-b32a-1895d9fce8d8 is fetched for user b579fae45f624cb0b2b0098a0b984c91. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b08be5-4abe-46df-8912-71011e185a37]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (5e35e7f6-90aa-4850-9803-869a70ab85a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4526eb24-0f59-4cef-bc58-1d94fb50d01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4526eb24-0f59-4cef-bc58-1d94fb50d01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323980229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5679933-519b-4434-ba36-40b79c93f03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:41Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef888682-3d65-464e-bfbe-b0e6d419c59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef888682-3d65-464e-bfbe-b0e6d419c59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a686783-c2a3-457c-82f0-7e6ba0b8065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a686783-c2a3-457c-82f0-7e6ba0b8065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5679933-519b-4434-ba36-40b79c93f03a', 'volume_name': 'volume-d5679933-519b-4434-ba36-40b79c93f03a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802326c6-6c6d-4c57-a77d-a1e5ccdbb2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802326c6-6c6d-4c57-a77d-a1e5ccdbb2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:40 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD Sep 17 23:57:40 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f9452a-1368-434a-a901-b488b0051703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:40 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume d5679933-519b-4434-ba36-40b79c93f03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5679933-519b-4434-ba36-40b79c93f03a', 'volume_size': 1} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:40 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d 1073741824" returned: 0 in 0.459s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:41 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d Sep 17 23:57:41 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:41 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:41 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD Sep 17 23:57:41 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:41 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.359s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e14130d-acae-422b-865f-62efb91089bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0829f5b3-d793-4b20-9d68-2f04c351c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Creating offline snapshot b1748279-a98d-4793-bc76-0b1cc83e22f7 of volume 3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:57:41 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Volume volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d (2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d): created successfully Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0829f5b3-d793-4b20-9d68-2f04c351c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Flow 'volume_create_manager' (7638899f-4f03-4bf9-957c-3515dd06e036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a8d18-894c-4b5e-8133-783ee04ab8d7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-41c110fe-ffe3-430d-8b56-c59145575dca tempest-CreateVolumesFromImageTest-1754757320 None] Created volume successfully. Sep 17 23:57:41 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:41 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 Sep 17 23:57:41 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:41 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19" returned: 0 in 0.369s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:41 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 1G Sep 17 23:57:41 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:42 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 1G" returned: 0 in 0.412s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:42 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 Sep 17 23:57:42 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-quobyte-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:42 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:42 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6329cb68-bf30-47ad-ac67-5a251d817b87]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:42 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7" returned: 0 in 0.316s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:42 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 is being set with open permissions: ugo+rw Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:42 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d Sep 17 23:57:42 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:42 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 Sep 17 23:57:42 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:42 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.272s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:57:42 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7" returned: 0 in 0.263s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:42 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d" returned: 0 in 0.379s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:42 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d Sep 17 23:57:42 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:42 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.info Sep 17 23:57:42 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:42 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d" returned: 0 in 0.256s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:42 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d" released by "delete_volume" :: held 0.695s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.info" returned: 0 in 0.263s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:42 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.info is being set with open permissions: ugo+rw Sep 17 23:57:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:43 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.info Sep 17 23:57:43 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Created reservations ['93682f1b-b3e3-4297-96a7-8c27abb0ff15', 'ac0ae90e-7be5-46bd-82ea-13267e009945', '2ffa439d-54fc-4c64-9785-4c22c45a6ed8', 'fbef6d30-ff42-4694-84ae-ee10c071bdbf'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:43 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:43 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:43 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.info" returned: 0 in 0.259s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.226s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1944689035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c897b124-afd7-463d-9ac8-c1a2eb183cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:39Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Creating volume c897b124-afd7-463d-9ac8-c1a2eb183cac {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:43 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:43 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac 1073741824 Sep 17 23:57:43 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9d0649fc-8e84-40f9-8f7a-0138ba9a01cd tempest-VolumeDependencyTests-497422822 None] Create snapshot completed successfully Sep 17 23:57:43 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-c25a1019-698c-4f8e-a15e-4405095b636d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.255s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Deleted volume successfully. Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-c25a1019-698c-4f8e-a15e-4405095b636d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5efed4e4-2110-48dc-b7ca-9e9ef30f5db7 tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-2c4e70aa-a7a4-4bda-9fd1-9572e7e1275d-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-quobyte-c25a1019-698c-4f8e-a15e-4405095b636d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-c25a1019-698c-4f8e-a15e-4405095b636d" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[88426060-7016-4e04-a63e-93b737ed173b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:43 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d Sep 17 23:57:43 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:43 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac 1073741824" returned: 0 in 0.500s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:43 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac Sep 17 23:57:43 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:43 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:43 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d Sep 17 23:57:43 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:44 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac" returned: 0 in 0.241s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.663s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357194159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2734126-b73c-41f1-b61f-1be584afdc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:39Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Creating volume d2734126-b73c-41f1-b61f-1be584afdc35 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:44 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7149f60e-a569-41c8-9695-81a1abd8504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c897b124-afd7-463d-9ac8-c1a2eb183cac', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:44 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 1073741824 Sep 17 23:57:44 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248f97a-fc96-4e84-8c3a-f2d833085e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:44 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume volume-c897b124-afd7-463d-9ac8-c1a2eb183cac (c897b124-afd7-463d-9ac8-c1a2eb183cac): created successfully Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248f97a-fc96-4e84-8c3a-f2d833085e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:44 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (386dc57b-7d19-4f1c-883d-989859cfa757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c25a1019-698c-4f8e-a15e-4405095b636d" returned: 0 in 0.277s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-c25a1019-698c-4f8e-a15e-4405095b636d" released by "delete_volume" :: held 0.711s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6d390209-d3e5-46b7-86b7-c39b86cbc63b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created volume successfully. Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Created reservations ['33f1fa31-3f1d-456b-a873-d9aa9c8f9629', '5389bbec-8449-4f56-885a-6660fbf94f14', '3fc56a54-0026-42b3-8efc-e15af4f1638e', '4cb4dcf8-53c1-4897-a875-fbdee7268f6a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:44 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:44 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:44 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.285s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Deleted volume successfully. Sep 17 23:57:44 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-9cf2669b-6b3d-4607-86c6-25f8ac68c712-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 1073741824" returned: 0 in 0.517s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-9cf2669b-6b3d-4607-86c6-25f8ac68c712-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-84aee92c-a9d3-41ac-8cb4-f303bb1aa67a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-c25a1019-698c-4f8e-a15e-4405095b636d-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-quobyte-9cf2669b-6b3d-4607-86c6-25f8ac68c712" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:44 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 Sep 17 23:57:44 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-9cf2669b-6b3d-4607-86c6-25f8ac68c712" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ada65-83da-4665-8d7e-1d760fe2e99a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Flow 'volume_create_manager' (85021f50-44be-4f6e-a700-1a8561f88d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ffa8d1-d25c-4b76-80d9-94e1b704a167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:44 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 Sep 17 23:57:44 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ffa8d1-d25c-4b76-80d9-94e1b704a167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1899749302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3e8361-35f6-4dbe-a62d-496525b1fcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7948133fd7746e4bb337d14f8c526a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1748279-a98d-4793-bc76-0b1cc83e22f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:45Z,use_quota=True,user_id='fe70b487881348d99bd3acad2e3213d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734c459-8353-403a-b9e5-5cdfda26f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734c459-8353-403a-b9e5-5cdfda26f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc6749c-4d83-4e49-8da2-5c7afe0ca738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc6749c-4d83-4e49-8da2-5c7afe0ca738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b3e8361-35f6-4dbe-a62d-496525b1fcd9', 'volume_name': 'volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9', 'volume_size': 1, 'snapshot_id': 'b1748279-a98d-4793-bc76-0b1cc83e22f7'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d517615-31bc-4d69-8eeb-d1decf8b12b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d517615-31bc-4d69-8eeb-d1decf8b12b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5be301-8841-4ba4-81e4-ed13d716126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:44 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Volume 8b3e8361-35f6-4dbe-a62d-496525b1fcd9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9', 'volume_size': 1, 'snapshot_id': 'b1748279-a98d-4793-bc76-0b1cc83e22f7'} Sep 17 23:57:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:45 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35" returned: 0 in 0.351s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.200s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915198066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6afc9da-1d1e-4342-b96b-f1c026d62f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:40Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Creating volume e6afc9da-1d1e-4342-b96b-f1c026d62f21 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:45 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b2cfce-fad7-4daa-805b-310ead551f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2734126-b73c-41f1-b61f-1be584afdc35', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f884bfc-3719-4f1b-9e47-e245d552e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:45 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 1073741824 Sep 17 23:57:45 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:45 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume volume-d2734126-b73c-41f1-b61f-1be584afdc35 (d2734126-b73c-41f1-b61f-1be584afdc35): created successfully Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f884bfc-3719-4f1b-9e47-e245d552e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (07b30a1c-94fb-4edf-b77e-d889881a2319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-cc61ffe6-abb9-4553-954e-eaa9f82643a1 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created volume successfully. Sep 17 23:57:45 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712" returned: 0 in 0.412s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:45 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712 Sep 17 23:57:45 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:45 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf2669b-6b3d-4607-86c6-25f8ac68c712" returned: 0 in 0.265s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:45 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 1073741824" returned: 0 in 0.440s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-9cf2669b-6b3d-4607-86c6-25f8ac68c712" released by "delete_volume" :: held 0.752s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:45 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 Sep 17 23:57:45 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Created reservations ['892d2cbc-5c03-4ff9-8eee-e0f1b7c77d14', 'b4d51d8d-9a90-4502-85e4-a98b01d5eb2a', 'f1358fd8-d69d-479c-be66-4282cd0243f9', 'a3916ccc-3b9b-4b22-97e0-14586357eef0'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:45 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:45 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:45 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21" returned: 0 in 0.287s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.393s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320043617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06a69fc-6cf3-4808-aa62-7afffb8171e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:40Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Creating volume d06a69fc-6cf3-4808-aa62-7afffb8171e1 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:45 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-81bfb079-752d-4cad-b134-e4aecaddbe89-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:45 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 1073741824 Sep 17 23:57:45 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b881b938-a634-4e76-83c7-8f10e725a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8335b367-adc6-40e6-b4d7-e01a81b26942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-81bfb079-752d-4cad-b134-e4aecaddbe89-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:45 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 (e6afc9da-1d1e-4342-b96b-f1c026d62f21): created successfully Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8335b367-adc6-40e6-b4d7-e01a81b26942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (52e7d97c-bdf2-4428-ab98-f4c35191cdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:45 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.328s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Deleted volume successfully. Sep 17 23:57:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-quobyte-81bfb079-752d-4cad-b134-e4aecaddbe89" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e67be0f2-3ac4-4afc-9af1-8694cce9f5ec tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created volume successfully. Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-fb66b702-122e-479d-a9dd-902f90694e3a tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-9cf2669b-6b3d-4607-86c6-25f8ac68c712-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-81bfb079-752d-4cad-b134-e4aecaddbe89" acquired by "delete_volume" :: waited 0.051s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2744182b-c27d-4a52-9547-f3e8744f766f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:46 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 Sep 17 23:57:46 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:46 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 1073741824" returned: 0 in 0.486s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:46 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 Sep 17 23:57:46 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:46 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89" returned: 0 in 0.400s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:46 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89 Sep 17 23:57:46 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:46 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1" returned: 0 in 0.261s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.856s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323980229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5679933-519b-4434-ba36-40b79c93f03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e93db60ccf4e648486e7ee9e5f2b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:41Z,use_quota=True,user_id='3a877dbaa5374af08f416d6fd3c5fe0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Creating volume d5679933-519b-4434-ba36-40b79c93f03a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:46 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:46 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a 1073741824 Sep 17 23:57:46 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7c5cfd-8a40-4ef9-b91a-8b469232cd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496f6737-b1de-45d2-8535-26842da9ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:46 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 (d06a69fc-6cf3-4808-aa62-7afffb8171e1): created successfully Sep 17 23:57:46 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496f6737-b1de-45d2-8535-26842da9ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (35154b75-aa46-4a4d-8088-d5bcb8eedd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-81bfb079-752d-4cad-b134-e4aecaddbe89" returned: 0 in 0.298s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-81bfb079-752d-4cad-b134-e4aecaddbe89" released by "delete_volume" :: held 0.762s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:46 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d9f8972e-d290-4740-9dbf-fcffc3f6b6e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created volume successfully. Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Created reservations ['e2c11706-8a1d-4b72-b41b-14469401f96d', 'f1b42420-85f8-428c-8017-4905c1957e4f', 'fea68813-1925-47ef-a6a4-af5159b61a64', 'c74c42ee-6fdd-4e53-ae34-396350b0a4d0'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:46 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:46 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-4e211985-b297-474d-b4b4-0055cee8d8ba-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-4e211985-b297-474d-b4b4-0055cee8d8ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "cinder-quobyte-4e211985-b297-474d-b4b4-0055cee8d8ba" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-4e211985-b297-474d-b4b4-0055cee8d8ba" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b27d1c-3f92-4ea1-90d5-bff88c19b39e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:47 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a 1073741824" returned: 0 in 0.568s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:47 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.318s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Deleted volume successfully. Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c00a50-3736-4ef0-9cb7-e59b773eb56f tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-81bfb079-752d-4cad-b134-e4aecaddbe89-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:47 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a Sep 17 23:57:47 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:47 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba Sep 17 23:57:47 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:47 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.169s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e62d36853354849972def20735e77ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:39Z,use_quota=True,user_id='b579fae45f624cb0b2b0098a0b984c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c513cc84-d22a-4a1c-9466-3b513bbcbc94),volume_type_id=c513cc84-d22a-4a1c-9466-3b513bbcbc94)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Creating volume 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:47 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:47 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba" returned: 0 in 0.415s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:47 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f 1073741824 Sep 17 23:57:47 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f9452a-1368-434a-a901-b488b0051703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5679933-519b-4434-ba36-40b79c93f03a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476bb7b8-4b45-4b06-8ab8-c33c629743c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:47 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba Sep 17 23:57:47 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:47 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Volume volume-d5679933-519b-4434-ba36-40b79c93f03a (d5679933-519b-4434-ba36-40b79c93f03a): created successfully Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476bb7b8-4b45-4b06-8ab8-c33c629743c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Flow 'volume_create_manager' (5e35e7f6-90aa-4850-9803-869a70ab85a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6a64a26d-83ce-48ea-80b5-72724f83510b tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created volume successfully. Sep 17 23:57:47 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4e211985-b297-474d-b4b4-0055cee8d8ba" returned: 0 in 0.273s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-quobyte-4e211985-b297-474d-b4b4-0055cee8d8ba" released by "delete_volume" :: held 0.746s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Created reservations ['613cffc9-2924-483a-9ff8-59a6b96e58ab', '8fd1162d-cf6b-4c1d-82a0-b36568d51f05', 'e9f88cd0-277c-4379-b61a-23b341ccbb10', '1ed7bec4-8eca-45e1-b9fc-9128737587e5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:48 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f 1073741824" returned: 0 in 0.463s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:48 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:48 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:48 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f Sep 17 23:57:48 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:48 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.263s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Deleted volume successfully. Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-62ec77f3-43b9-46d1-bf12-8bb33ae073ae tempest-CreateVolumesFromImageTest-1754757320 None] Lock "cinder-4e211985-b297-474d-b4b4-0055cee8d8ba-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:48 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.359s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-quobyte-b1748279-a98d-4793-bc76-0b1cc83e22f7-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-b1748279-a98d-4793-bc76-0b1cc83e22f7-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Creating volume 8b3e8361-35f6-4dbe-a62d-496525b1fcd9 from snapshot b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-quobyte-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Attempting download of b628dba4-29ed-48ea-b32a-1895d9fce8d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'metadata': {}}])) to volume 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] snapshot: b1748279-a98d-4793-bc76-0b1cc83e22f7, volume: 8b3e8361-35f6-4dbe-a62d-496525b1fcd9, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-d5679933-519b-4434-ba36-40b79c93f03a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-d5679933-519b-4434-ba36-40b79c93f03a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbf6e3e-e90f-4687-a3c8-d6febdbdef52]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[80427182-015e-4915-99d6-54b027c3dd9b]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b628dba4-29ed-48ea-b32a-1895d9fce8d8_alx_fj51 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-quobyte-d5679933-519b-4434-ba36-40b79c93f03a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-d5679933-519b-4434-ba36-40b79c93f03a" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea1355-cdd1-4320-8d31-1ec778b9e205]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:48 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b628dba4-29ed-48ea-b32a-1895d9fce8d8_alx_fj51 Sep 17 23:57:48 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:48 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 Sep 17 23:57:48 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:48 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a Sep 17 23:57:48 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:48 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b628dba4-29ed-48ea-b32a-1895d9fce8d8_alx_fj51" returned: 0 in 0.368s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b628dba4-29ed-48ea-b32a-1895d9fce8d8_alx_fj51 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:49 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7" returned: 0 in 0.527s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a192dbd4-83c9-4cf9-b454-351da0d5176f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:49 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b628dba4-29ed-48ea-b32a-1895d9fce8d8_alx_fj51 Sep 17 23:57:49 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:49 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a" returned: 0 in 0.504s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:49 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a Sep 17 23:57:49 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:49 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 Sep 17 23:57:49 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:49 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b628dba4-29ed-48ea-b32a-1895d9fce8d8_alx_fj51" returned: 1 in 0.473s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b628dba4-29ed-48ea-b32a-1895d9fce8d8_alx_fj51' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2629c26-1bbf-4f7e-bb6c-1b464244d00b]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:49 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d5679933-519b-4434-ba36-40b79c93f03a" returned: 0 in 0.307s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-d5679933-519b-4434-ba36-40b79c93f03a" released by "delete_volume" :: held 0.870s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:49 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19" returned: 0 in 0.464s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:57:49 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD Sep 17 23:57:49 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created reservations ['b5958176-307e-406e-87ba-2662d1e1c803', 'dd8d5be8-5cb7-4ae8-bbcc-6e3ef9825d04', 'a2f07cc8-9969-48c6-8e38-0d0523edbd21', '80fdcdd5-51b3-4ecf-a832-d2d1728f7448'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:49 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 Sep 17 23:57:49 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:49 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:49 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-d06a69fc-6cf3-4808-aa62-7afffb8171e1-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-d06a69fc-6cf3-4808-aa62-7afffb8171e1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-quobyte-d06a69fc-6cf3-4808-aa62-7afffb8171e1" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-d06a69fc-6cf3-4808-aa62-7afffb8171e1" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:49 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7936a4d5-cfe2-4201-b440-f31d415979d0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:50 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD Sep 17 23:57:50 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:50 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 Sep 17 23:57:50 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:50 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.418s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:50 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Deleted volume successfully. Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1231eb9c-64bd-4701-b669-149a5bf2b1e3 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-d5679933-519b-4434-ba36-40b79c93f03a-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:50 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1" returned: 0 in 0.678s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:50 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD" returned: 1 in 0.743s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] b628dba4-29ed-48ea-b32a-1895d9fce8d8 was raw, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:57:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:50 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1 Sep 17 23:57:50 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:50 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f Sep 17 23:57:50 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:51 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d06a69fc-6cf3-4808-aa62-7afffb8171e1" returned: 0 in 0.580s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-d06a69fc-6cf3-4808-aa62-7afffb8171e1" released by "delete_volume" :: held 1.334s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created reservations ['90144b71-7552-4b44-9451-71eef825fbfc', 'e06f0cbf-21d7-4423-8ba8-448c6896c4a3', '38eed658-7822-46af-ace8-a5e438007e71', '86412590-a9af-48cb-9de8-a0d13fc85915'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:51 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:51 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:51 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:51 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Deleted volume successfully. Sep 17 23:57:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-96914322-1df0-4f75-a5b0-94c1216ff51f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-d06a69fc-6cf3-4808-aa62-7afffb8171e1-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:52 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f" returned: 0 in 1.404s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b628dba4-29ed-48ea-b32a-1895d9fce8d8_3wm0vqqpdevstack@QuobyteHD, size 0.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:57:52 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:52 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f 1G Sep 17 23:57:52 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-e6afc9da-1d1e-4342-b96b-f1c026d62f21-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-e6afc9da-1d1e-4342-b96b-f1c026d62f21-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-quobyte-e6afc9da-1d1e-4342-b96b-f1c026d62f21" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-e6afc9da-1d1e-4342-b96b-f1c026d62f21" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7e4731-c050-4650-9830-4475888ac0b0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:52 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 Sep 17 23:57:52 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:52 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f 1G" returned: 0 in 0.922s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Downloaded image b628dba4-29ed-48ea-b32a-1895d9fce8d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'metadata': {}}])) to volume 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Temporary image b628dba4-29ed-48ea-b32a-1895d9fce8d8 for user b579fae45f624cb0b2b0098a0b984c91 is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Marking volume 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Copying metadata from image b628dba4-29ed-48ea-b32a-1895d9fce8d8 to 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Creating volume glance metadata for volume 4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f backed by image b628dba4-29ed-48ea-b32a-1895d9fce8d8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '78883878e8b8caaaee9128be576567bc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc559780-3055-48f2-84c4-23b54d76c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f', 'volume_size': 1, 'image_id': 'b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78883878e8b8caaaee9128be576567bc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e62d36853354849972def20735e77ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dffc8d7a249e060b04c1d4c0418d7c8af4e5799560e79437fa50353faaaa6220e5cfca73a5057806d1c6f66f3f3ce4d313c2b5c517ea7c0f9fd33d8b3b180d88', 'id': 'b628dba4-29ed-48ea-b32a-1895d9fce8d8', 'created_at': datetime.datetime(2026, 9, 17, 21, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b628dba4-29ed-48ea-b32a-1895d9fce8d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d3da9-3c5f-46a0-90ae-b7db7ee3ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:53 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Volume volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f (4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f): created successfully Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d3da9-3c5f-46a0-90ae-b7db7ee3ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Flow 'volume_create_manager' (ed99a9c1-2d5e-4256-a268-9003e70a419b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:53 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5c6a2f45-7dbc-465b-a2ed-52faa86631e1 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Created volume successfully. Sep 17 23:57:53 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21" returned: 0 in 0.775s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:53 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21 Sep 17 23:57:53 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:53 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e6afc9da-1d1e-4342-b96b-f1c026d62f21" returned: 0 in 0.431s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-e6afc9da-1d1e-4342-b96b-f1c026d62f21" released by "delete_volume" :: held 1.320s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created reservations ['08b85acc-3c33-4d0b-9d1d-13b286ef7c26', 'd7cf6f8c-db6a-49b9-b9a2-ca40b8395baa', 'db420148-8728-40b0-bdd9-5987ea3fc11b', '5ffa33dd-553d-4536-a6ca-aa41f19f621f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:53 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:53 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Acquiring lock "cinder-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "cinder-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Acquiring lock "cinder-quobyte-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "cinder-quobyte-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f" acquired by "delete_volume" :: waited 0.045s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc3c0d-f23b-4d6b-9888-b254250151ba]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:54 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.519s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:54 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Deleted volume successfully. Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12b58469-0bae-4974-b2e4-cd5aff3bd79f tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-e6afc9da-1d1e-4342-b96b-f1c026d62f21-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:54 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f Sep 17 23:57:54 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-d2734126-b73c-41f1-b61f-1be584afdc35-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-d2734126-b73c-41f1-b61f-1be584afdc35-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:54 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-quobyte-d2734126-b73c-41f1-b61f-1be584afdc35" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-d2734126-b73c-41f1-b61f-1be584afdc35" acquired by "delete_volume" :: waited 0.034s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1507ab-491a-451e-96de-8b2720f4333c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:55 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f" returned: 0 in 0.879s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:55 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f Sep 17 23:57:55 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:55 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 Sep 17 23:57:55 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:55 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f" returned: 0 in 0.654s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "cinder-quobyte-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f" released by "delete_volume" :: held 1.640s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:55 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35" returned: 0 in 0.852s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:56 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35 Sep 17 23:57:56 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Created reservations ['4a369a04-3fc2-40cb-be37-7fd90d7b2e3c', 'efd12d07-aae6-4b23-8226-08df43729f9d', 'f3f552ff-347d-4379-a7a9-1f30577c660e', '0d4c8cca-7290-4024-a1db-f2978cae9bae'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:56 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:56 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:56 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d2734126-b73c-41f1-b61f-1be584afdc35" returned: 0 in 0.537s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-d2734126-b73c-41f1-b61f-1be584afdc35" released by "delete_volume" :: held 1.501s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created reservations ['154767e5-830e-4d5e-ac27-b549271a7fc4', '65b160fb-3039-4645-afbf-18261babc782', '72e3f643-5922-4404-9d43-a2b7001ebaf5', 'e12ca4ca-9afb-43b2-a928-cbd5215b8cb4'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:56 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.555s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Deleted volume successfully. Sep 17 23:57:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-576f31e2-0f1a-43bc-81cc-fcfa8ed8d8b9 tempest-VolumeAndVolumeTypeFromImageTest-2082028024 None] Lock "cinder-4a1b04ce-a23c-48e6-bfa3-0bbcc5885f5f-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:56 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:56 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:57 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.472s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Deleted volume successfully. Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-0a9aada2-5a13-4754-b548-11c6ba21ae32 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-d2734126-b73c-41f1-b61f-1be584afdc35-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-c897b124-afd7-463d-9ac8-c1a2eb183cac-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-c897b124-afd7-463d-9ac8-c1a2eb183cac-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-quobyte-c897b124-afd7-463d-9ac8-c1a2eb183cac" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-c897b124-afd7-463d-9ac8-c1a2eb183cac" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b9bd7-af87-4cb5-83cd-d85c037ea719]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:58 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac Sep 17 23:57:58 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:58 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac" returned: 0 in 0.634s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:58 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac Sep 17 23:57:58 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Flow 'volume_create_manager' (f056f474-287c-4b65-8c37-5f26703e83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9d614e-366a-46f5-ad5a-b5f69034eca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:58 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9d614e-366a-46f5-ad5a-b5f69034eca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3f8d67-2758-4a3d-b18c-00806ca601d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bfdaf9ff0d4c5d99d5f97e71091258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:59Z,use_quota=True,user_id='4c70382a9f954ae893ade14559a54102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3b1123-9244-480b-8e87-36e462ceb50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3b1123-9244-480b-8e87-36e462ceb50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b27ea28-19fc-454b-b337-96f7c57f1279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.image.glance [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Creating Keystone auth plugin from conf {{(pid=85956) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" returned: 0 in 9.224s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19, size 1024.00 MB, duration 9.23 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:57:58 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Converted 1024.00 MB image at 110.98 MB/s Sep 17 23:57:58 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 is being set with open permissions: ugo+rw Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:58 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 Sep 17 23:57:58 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:58 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-c897b124-afd7-463d-9ac8-c1a2eb183cac" returned: 0 in 0.495s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-c897b124-afd7-463d-9ac8-c1a2eb183cac" released by "delete_volume" :: held 1.231s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:59 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" returned: 0 in 0.301s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" released by "_copy_volume_from_snapshot" :: held 10.658s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created reservations ['7a18d27d-1e78-4a53-800c-2cc2f60dff04', '91a739c3-24d3-4830-95bf-0dc8eaa4148b', '30483c01-811c-4a4d-ad04-e1d6c10e7405', '49aba36b-c8dc-44af-84d9-ae758ae9640b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b27ea28-19fc-454b-b337-96f7c57f1279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f3f8d67-2758-4a3d-b18c-00806ca601d8', 'volume_name': 'volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8', 'volume_size': 1, 'image_id': 'cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff66759e8a40f217ec34497efe365d00', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92bfdaf9ff0d4c5d99d5f97e71091258', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be7892aa8911a231df9158b1b47f35fcd11f9c29ed7d19351cf20d018b9671c2ace4bf29d1d90290466950b713b7240a0eeec79e7161f8abedbd8c6f90fcc674', 'id': 'cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'created_at': datetime.datetime(2026, 9, 17, 21, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94/file', 'properties': {}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba93f5a1-aeb6-4145-bd0c-4e1de57bed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba93f5a1-aeb6-4145-bd0c-4e1de57bed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb7f316-fc06-4e28-994e-be39cc50abea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Volume 7f3f8d67-2758-4a3d-b18c-00806ca601d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8', 'volume_size': 1, 'image_id': 'cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff66759e8a40f217ec34497efe365d00', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92bfdaf9ff0d4c5d99d5f97e71091258', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be7892aa8911a231df9158b1b47f35fcd11f9c29ed7d19351cf20d018b9671c2ace4bf29d1d90290466950b713b7240a0eeec79e7161f8abedbd8c6f90fcc674', 'id': 'cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'created_at': datetime.datetime(2026, 9, 17, 21, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94/file', 'properties': {}}, 'image_service': } Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Trying to clone 7f3f8d67-2758-4a3d-b18c-00806ca601d8 from image cb6d6a9d-5dd8-4510-b445-a27c999baa94 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'metadata': {}}]). {{(pid=85956) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-b1748279-a98d-4793-bc76-0b1cc83e22f7-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" released by "_create_volume_from_snapshot" :: held 10.782s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.811s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5be301-8841-4ba4-81e4-ed13d716126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9', 'volume_size': 1, 'snapshot_id': 'b1748279-a98d-4793-bc76-0b1cc83e22f7'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dd56e3-22ea-4920-908f-df2df41ccfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:57:59 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Volume volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 (8b3e8361-35f6-4dbe-a62d-496525b1fcd9): created successfully Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dd56e3-22ea-4920-908f-df2df41ccfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Flow 'volume_create_manager' (85021f50-44be-4f6e-a700-1a8561f88d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 23:57:59 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Image download 0.00 MB at 0.00 MB/s Sep 17 23:57:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-734354fa-cea0-4a4a-88b8-1597554bb2a9 tempest-VolumeDependencyTests-497422822 None] Created volume successfully. Sep 17 23:57:59 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:57:59 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b135cba-5124-4b89-8ae3-177a309f4918]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:59 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD Sep 17 23:57:59 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-b1748279-a98d-4793-bc76-0b1cc83e22f7-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Lock "cinder-b1748279-a98d-4793-bc76-0b1cc83e22f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-quobyte-3cd25cce-65d8-4dba-8617-fd4edb44cd19" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-3cd25cce-65d8-4dba-8617-fd4edb44cd19" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-quobyte-b1748279-a98d-4793-bc76-0b1cc83e22f7" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-b1748279-a98d-4793-bc76-0b1cc83e22f7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:57:59 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Deleting offline snapshot b1748279-a98d-4793-bc76-0b1cc83e22f7 of volume 3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] snapshot_file for this snap is: volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.352s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:57:59 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Deleted volume successfully. Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3244dcfe-9ecf-470a-ab3d-557672e7da77]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-90bcd8e6-508f-4b33-ad52-1ed00022bbeb tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-c897b124-afd7-463d-9ac8-c1a2eb183cac-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:57:59 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 Sep 17 23:57:59 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:59 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:57:59 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD Sep 17 23:57:59 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:57:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-e10b6a5c-f553-4234-91af-98afc8154ca3-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-e10b6a5c-f553-4234-91af-98afc8154ca3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "cinder-quobyte-e10b6a5c-f553-4234-91af-98afc8154ca3" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-e10b6a5c-f553-4234-91af-98afc8154ca3" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:00 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7" returned: 0 in 0.508s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f7a489-1a79-42e7-aca2-6f3c2647292c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[889a02be-881c-4190-81bc-7a92e8839917]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:00 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD" returned: 1 in 0.459s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Temporary image cb6d6a9d-5dd8-4510-b445-a27c999baa94 is fetched for user 4c70382a9f954ae893ade14559a54102. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 23:58:00 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 Sep 17 23:58:00 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1459a4de-1a89-4ce3-93a7-0980f45a398e]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:00 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 Sep 17 23:58:00 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:00 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD Sep 17 23:58:00 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:00 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3" returned: 0 in 0.447s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:00 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3 Sep 17 23:58:00 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:00 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:00 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD Sep 17 23:58:00 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:00 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19" returned: 0 in 0.723s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:00 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 Sep 17 23:58:00 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:00 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-e10b6a5c-f553-4234-91af-98afc8154ca3" returned: 0 in 0.329s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-quobyte-e10b6a5c-f553-4234-91af-98afc8154ca3" released by "delete_volume" :: held 0.851s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:01 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Created reservations ['11da6d19-5bc4-492b-9eca-a14bae84215a', '670c0b8f-5ca4-4e04-84c3-7190051b928b', '167fc06f-8d8d-4a7f-beaf-1da27c9e43df', '0247e634-8d1b-4fbc-b2aa-2f7f887af7d6'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3f8d67-2758-4a3d-b18c-00806ca601d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bfdaf9ff0d4c5d99d5f97e71091258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:57:59Z,use_quota=True,user_id='4c70382a9f954ae893ade14559a54102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Creating volume 7f3f8d67-2758-4a3d-b18c-00806ca601d8 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:01 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:01 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 1073741824 Sep 17 23:58:01 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:01 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:01 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:01 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7" returned: 0 in 0.499s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:01 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7 Sep 17 23:58:01 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:01 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.424s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Deleted volume successfully. Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4a6e3bcc-7a30-4227-abe7-e4d374a941e5 tempest-CreateVolumesFromSourceVolumeTest-497995183 None] Lock "cinder-e10b6a5c-f553-4234-91af-98afc8154ca3-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:01 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 1073741824" returned: 0 in 0.665s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:01 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19.b1748279-a98d-4793-bc76-0b1cc83e22f7" returned: 0 in 0.405s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:01 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 Sep 17 23:58:01 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-b1748279-a98d-4793-bc76-0b1cc83e22f7" released by "_delete_snapshot" :: held 2.270s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-3cd25cce-65d8-4dba-8617-fd4edb44cd19" released by "delete_snapshot" :: held 2.291s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Created reservations ['13daa1ca-f333-4dfd-86fb-aeb631bd9ecc', '85f5b565-c621-4ae1-88b5-0ce55f1437e4', '41f3da8b-e030-483a-b370-5b00ff03b282', '52437426-2325-4ca2-80c4-d3a75386f8d6'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Delete snapshot completed successfully. Sep 17 23:58:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47c32d3e-f475-4679-a9da-4960f472f89a tempest-VolumeDependencyTests-497422822 None] Lock "cinder-b1748279-a98d-4793-bc76-0b1cc83e22f7-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:02 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8" returned: 0 in 0.314s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Attempting download of cb6d6a9d-5dd8-4510-b445-a27c999baa94 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'metadata': {}}])) to volume 7f3f8d67-2758-4a3d-b18c-00806ca601d8. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e67e1-5078-4435-8acc-38aeeb8afd29]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6d6a9d-5dd8-4510-b445-a27c999baa94_5jllwxw8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:02 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6d6a9d-5dd8-4510-b445-a27c999baa94_5jllwxw8 Sep 17 23:58:02 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:02 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6d6a9d-5dd8-4510-b445-a27c999baa94_5jllwxw8" returned: 0 in 0.338s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6d6a9d-5dd8-4510-b445-a27c999baa94_5jllwxw8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:02 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6d6a9d-5dd8-4510-b445-a27c999baa94_5jllwxw8 Sep 17 23:58:02 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-3cd25cce-65d8-4dba-8617-fd4edb44cd19-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Lock "cinder-3cd25cce-65d8-4dba-8617-fd4edb44cd19-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-quobyte-3cd25cce-65d8-4dba-8617-fd4edb44cd19" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:02 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-3cd25cce-65d8-4dba-8617-fd4edb44cd19" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6d6a9d-5dd8-4510-b445-a27c999baa94_5jllwxw8" returned: 1 in 0.426s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6d6a9d-5dd8-4510-b445-a27c999baa94_5jllwxw8' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb610415-6f23-4b56-8a22-003ba799b6d2]: (4, 'raw') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e47ea2-1bc8-4049-9b5c-0ccd156e1bd5]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:03 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD Sep 17 23:58:03 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:03 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 Sep 17 23:58:03 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (9afe177d-bbbb-47bd-9b0a-f70ff205b18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8952b0f4-0846-43c2-ba6a-6af8392bf8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:03 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8952b0f4-0846-43c2-ba6a-6af8392bf8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705706419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7857e954-2766-40fa-9fef-350aa871a187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:03Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a05f81-fbbf-43a8-b7cf-84ee0b4104d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a05f81-fbbf-43a8-b7cf-84ee0b4104d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05769bc-0e0a-4373-a08c-1e9ca5c42dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05769bc-0e0a-4373-a08c-1e9ca5c42dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7857e954-2766-40fa-9fef-350aa871a187', 'volume_name': 'volume-7857e954-2766-40fa-9fef-350aa871a187', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a732fbb-eaf7-49ce-a2a7-822a6fed746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a732fbb-eaf7-49ce-a2a7-822a6fed746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1c0853-3d4e-4bb7-bebe-5f334ece0b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:03 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume 7857e954-2766-40fa-9fef-350aa871a187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7857e954-2766-40fa-9fef-350aa871a187', 'volume_size': 1} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705706419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7857e954-2766-40fa-9fef-350aa871a187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:03Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Creating volume 7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:03 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:03 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19" returned: 0 in 0.500s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:03 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 1073741824 Sep 17 23:58:03 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:03 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19 Sep 17 23:58:03 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:03 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD Sep 17 23:58:03 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:03 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD' failed. Not Retrying. {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] cb6d6a9d-5dd8-4510-b445-a27c999baa94 was raw, converting to qcow2 {{(pid=85956) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:03 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-3cd25cce-65d8-4dba-8617-fd4edb44cd19" returned: 0 in 0.311s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:03 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 Sep 17 23:58:03 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-3cd25cce-65d8-4dba-8617-fd4edb44cd19" released by "delete_volume" :: held 0.898s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:03 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Created reservations ['3e4e9819-908d-47d0-97b7-f32e8e67f3f8', '0eb27dad-7078-42d8-82bf-9e022ca3b08a', 'fef0000e-cb1e-40ac-84e6-ee74ad962427', '988849a5-48e2-4e4c-884b-e93d97416b90'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:04 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:04 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:04 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 1073741824" returned: 0 in 0.714s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:04 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 Sep 17 23:58:04 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:04 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8" returned: 0 in 0.652s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb6d6a9d-5dd8-4510-b445-a27c999baa94_bq4jljhodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:58:04 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:04 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.426s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Deleted volume successfully. Sep 17 23:58:04 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 1G Sep 17 23:58:04 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9d6a69b1-ddcd-4735-bd55-7d2b3c0545fd tempest-VolumeDependencyTests-497422822 None] Lock "cinder-3cd25cce-65d8-4dba-8617-fd4edb44cd19-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:04 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187" returned: 0 in 0.330s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1c0853-3d4e-4bb7-bebe-5f334ece0b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7857e954-2766-40fa-9fef-350aa871a187', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe9f8eb-7a4d-401c-ad71-cff24747964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:04 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume volume-7857e954-2766-40fa-9fef-350aa871a187 (7857e954-2766-40fa-9fef-350aa871a187): created successfully Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe9f8eb-7a4d-401c-ad71-cff24747964e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (9afe177d-bbbb-47bd-9b0a-f70ff205b18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-98c654e9-e1ae-4854-b22b-b8d21da858d6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created volume successfully. Sep 17 23:58:04 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 1G" returned: 0 in 0.355s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Downloaded image cb6d6a9d-5dd8-4510-b445-a27c999baa94 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'metadata': {}}])) to volume 7f3f8d67-2758-4a3d-b18c-00806ca601d8 successfully. {{(pid=85956) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Temporary image cb6d6a9d-5dd8-4510-b445-a27c999baa94 for user 4c70382a9f954ae893ade14559a54102 is deleted. {{(pid=85956) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.volume_utils [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Marking volume 7f3f8d67-2758-4a3d-b18c-00806ca601d8 as bootable. {{(pid=85956) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Copying metadata from image cb6d6a9d-5dd8-4510-b445-a27c999baa94 to 7f3f8d67-2758-4a3d-b18c-00806ca601d8. {{(pid=85956) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Creating volume glance metadata for volume 7f3f8d67-2758-4a3d-b18c-00806ca601d8 backed by image cb6d6a9d-5dd8-4510-b445-a27c999baa94 with: {'image_id': 'cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ff66759e8a40f217ec34497efe365d00', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85956) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb7f316-fc06-4e28-994e-be39cc50abea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8', 'volume_size': 1, 'image_id': 'cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff66759e8a40f217ec34497efe365d00', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92bfdaf9ff0d4c5d99d5f97e71091258', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be7892aa8911a231df9158b1b47f35fcd11f9c29ed7d19351cf20d018b9671c2ace4bf29d1d90290466950b713b7240a0eeec79e7161f8abedbd8c6f90fcc674', 'id': 'cb6d6a9d-5dd8-4510-b445-a27c999baa94', 'created_at': datetime.datetime(2026, 9, 17, 21, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 21, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6d6a9d-5dd8-4510-b445-a27c999baa94/file', 'properties': {}}, 'image_service': }' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d75a0b-8744-4556-87df-e29734345c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:04 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Volume volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 (7f3f8d67-2758-4a3d-b18c-00806ca601d8): created successfully Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d75a0b-8744-4556-87df-e29734345c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Flow 'volume_create_manager' (f056f474-287c-4b65-8c37-5f26703e83a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-13ff903b-1cd7-4cf5-85e6-821b072ab63a tempest-VolumeImageDependencyTests-90909254 None] Created volume successfully. Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-8b3e8361-35f6-4dbe-a62d-496525b1fcd9-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-8b3e8361-35f6-4dbe-a62d-496525b1fcd9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "cinder-quobyte-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37be790-cce4-4e0d-9b6e-95d5607522f1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:05 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 Sep 17 23:58:05 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:05 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" returned: 0 in 0.393s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:05 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9 Sep 17 23:58:05 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Creating offline snapshot 894e336f-2546-4461-b096-804ff89ab414 of volume 7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2887c1a-d54c-40ee-8958-af6cb585e2fe]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:05 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 Sep 17 23:58:05 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:05 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" returned: 0 in 0.298s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-quobyte-8b3e8361-35f6-4dbe-a62d-496525b1fcd9" released by "delete_volume" :: held 0.749s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Created reservations ['d82e6728-4295-4302-9ecf-4d18e56a63a1', '8373d9f8-5fd2-48fa-ab14-9a3600a5e168', '542d84f3-e1e5-4638-a5d6-ffa1a03a21f4', '79bf7462-292f-486c-a88b-b3e35da71168'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Acquiring lock "cinder-7f3f8d67-2758-4a3d-b18c-00806ca601d8-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Lock "cinder-7f3f8d67-2758-4a3d-b18c-00806ca601d8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:06 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:06 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Acquiring lock "cinder-quobyte-7f3f8d67-2758-4a3d-b18c-00806ca601d8" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Lock "cinder-quobyte-7f3f8d67-2758-4a3d-b18c-00806ca601d8" acquired by "delete_volume" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[531e6cd0-0623-4fe4-a64d-5e4386970d9f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:06 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187" returned: 0 in 0.585s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:06 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 1G Sep 17 23:58:06 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:06 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 Sep 17 23:58:06 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:06 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.413s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Deleted volume successfully. Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-1cb4d046-eabd-4b71-a867-40f9a8940f89 tempest-VolumeDependencyTests-497422822 None] Lock "cinder-8b3e8361-35f6-4dbe-a62d-496525b1fcd9-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:06 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8" returned: 0 in 0.559s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:06 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8 Sep 17 23:58:06 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:06 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 1G" returned: 0 in 0.573s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7857e954-2766-40fa-9fef-350aa871a187 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:06 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7857e954-2766-40fa-9fef-350aa871a187 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 Sep 17 23:58:06 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:07 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7f3f8d67-2758-4a3d-b18c-00806ca601d8" returned: 0 in 0.293s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Lock "cinder-quobyte-7f3f8d67-2758-4a3d-b18c-00806ca601d8" released by "delete_volume" :: held 0.937s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Created reservations ['1609b013-e768-4e9f-8589-4059f65bf446', 'cdbe237a-3f41-44d6-ba9b-7ad6c11a9401', 'dabdfaec-0cfd-4c69-a739-e65917a6f57f', '6896d453-f614-416d-a57f-2aef20d49083'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:07 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7857e954-2766-40fa-9fef-350aa871a187 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414" returned: 0 in 0.410s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:07 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 is being set with open permissions: ugo+rw Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:07 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 Sep 17 23:58:07 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:07 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:07 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:07 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414" returned: 0 in 0.319s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:07 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:07 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Deleted volume successfully. Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-143c7c17-85e3-47f9-824e-d28ee78e431c tempest-VolumeImageDependencyTests-90909254 None] Lock "cinder-7f3f8d67-2758-4a3d-b18c-00806ca601d8-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:07 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.info Sep 17 23:58:07 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:07 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.info" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:07 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.info is being set with open permissions: ugo+rw Sep 17 23:58:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:07 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.info Sep 17 23:58:07 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:08 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.info" returned: 0 in 0.262s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5896b44f-978f-4af8-9ace-be113e120f93 tempest-CreateVolumesFromSnapshotTest-626607024 None] Create snapshot completed successfully Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (63c54d4e-0a8c-46c3-aac7-59d0effd22c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd0e63-6d0f-4f74-8c86-33501ec629d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd0e63-6d0f-4f74-8c86-33501ec629d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-719608512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae541b82-b76b-43d1-b712-20c10a90590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:09Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0139c-08fe-49aa-b596-15a1ca113002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0139c-08fe-49aa-b596-15a1ca113002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb94d1-d091-4cac-b5c6-d800ec33b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb94d1-d091-4cac-b5c6-d800ec33b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae541b82-b76b-43d1-b712-20c10a90590c', 'volume_name': 'volume-ae541b82-b76b-43d1-b712-20c10a90590c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7858d94-f2ce-47fc-9cb0-8734b2c25cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7858d94-f2ce-47fc-9cb0-8734b2c25cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2b0238-1377-4a74-9ccf-15f0c23bdeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:09 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume ae541b82-b76b-43d1-b712-20c10a90590c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae541b82-b76b-43d1-b712-20c10a90590c', 'volume_size': 1} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-719608512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae541b82-b76b-43d1-b712-20c10a90590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:09Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Creating volume ae541b82-b76b-43d1-b712-20c10a90590c {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:09 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:09 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c 1073741824 Sep 17 23:58:09 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:09 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (7538f8b1-e35a-4e5e-aa35-95d5a0777ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33842505-27b1-43c4-8646-5d16c95b27ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33842505-27b1-43c4-8646-5d16c95b27ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133458337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf5f780-5662-487a-92d9-1db45a6c4431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:10Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fec8b-8a99-4719-82f9-060c2d39fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fec8b-8a99-4719-82f9-060c2d39fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56e9441-9eb8-4e9c-bc83-f0131acff6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56e9441-9eb8-4e9c-bc83-f0131acff6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf5f780-5662-487a-92d9-1db45a6c4431', 'volume_name': 'volume-9cf5f780-5662-487a-92d9-1db45a6c4431', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2472d11c-e86d-44ce-b814-af093c4e7e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2472d11c-e86d-44ce-b814-af093c4e7e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda1c438-8dae-4d56-8d4c-94b74e57692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume 9cf5f780-5662-487a-92d9-1db45a6c4431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf5f780-5662-487a-92d9-1db45a6c4431', 'volume_size': 1} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:10 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c 1073741824" returned: 0 in 0.746s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:10 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c Sep 17 23:58:10 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (215e2cff-eda0-4b81-9ebb-c073b523d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5fda30-81ef-4544-97d7-d523fa830835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5fda30-81ef-4544-97d7-d523fa830835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665070310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a3e707-3aaf-4af2-ae4d-7f8f21e45bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:10Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b191a987-2aca-4b07-a50c-55cac3f4b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b191a987-2aca-4b07-a50c-55cac3f4b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022c83ee-18ae-4cf0-9dba-4b09ba1f80be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022c83ee-18ae-4cf0-9dba-4b09ba1f80be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a3e707-3aaf-4af2-ae4d-7f8f21e45bff', 'volume_name': 'volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346a229a-cf94-48c3-bd6a-b3a8065a7ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346a229a-cf94-48c3-bd6a-b3a8065a7ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe62f57-c64a-4aa7-83cd-16f10d807ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume 34a3e707-3aaf-4af2-ae4d-7f8f21e45bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff', 'volume_size': 1} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:10 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c" returned: 0 in 0.452s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133458337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf5f780-5662-487a-92d9-1db45a6c4431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:10Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Creating volume 9cf5f780-5662-487a-92d9-1db45a6c4431 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:10 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2b0238-1377-4a74-9ccf-15f0c23bdeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae541b82-b76b-43d1-b712-20c10a90590c', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 1073741824 Sep 17 23:58:10 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3b2f8a-82b5-4c87-b5a0-0d16b217bcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume volume-ae541b82-b76b-43d1-b712-20c10a90590c (ae541b82-b76b-43d1-b712-20c10a90590c): created successfully Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3b2f8a-82b5-4c87-b5a0-0d16b217bcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (63c54d4e-0a8c-46c3-aac7-59d0effd22c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c42b94f0-c1b5-4124-82c6-777d6d1cbb85 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created volume successfully. Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (e906e7c4-d8de-4747-93ba-c0efdadc1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4900b29-4007-4bc9-8221-4c9c5fd80590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4900b29-4007-4bc9-8221-4c9c5fd80590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28664024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2bd888-11a6-4798-a74c-c5fd721c8bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:11Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e51e8ce-8755-4592-916c-27d91799ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e51e8ce-8755-4592-916c-27d91799ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2106635-8ae3-4522-8e95-34054d09cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2106635-8ae3-4522-8e95-34054d09cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2bd888-11a6-4798-a74c-c5fd721c8bca', 'volume_name': 'volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7661acd3-ae58-4fcc-bb16-2dcc2a20dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7661acd3-ae58-4fcc-bb16-2dcc2a20dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d918af9d-4ba4-4601-9fa2-1f9453a75140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume 8b2bd888-11a6-4798-a74c-c5fd721c8bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca', 'volume_size': 1} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:11 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (24f581f1-ee14-44a8-8df6-4dd7a4d9412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833cda94-4db0-4295-bf30-8b08d1a0d276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 1073741824" returned: 0 in 0.727s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833cda94-4db0-4295-bf30-8b08d1a0d276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487599317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e510fd-56ca-448e-bfe4-8aef37cfdc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:11Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a23375b-0461-440e-8c07-58d8784f0762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a23375b-0461-440e-8c07-58d8784f0762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4164dd9-f804-44cf-8f26-86849ef70a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4164dd9-f804-44cf-8f26-86849ef70a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e510fd-56ca-448e-bfe4-8aef37cfdc65', 'volume_name': 'volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eaa0953-e02e-45dc-8c4b-cd49c8aa69e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eaa0953-e02e-45dc-8c4b-cd49c8aa69e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0065e8f1-3f9b-4f88-a751-09a7ffcd0f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume 69e510fd-56ca-448e-bfe4-8aef37cfdc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65', 'volume_size': 1} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:11 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 Sep 17 23:58:11 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:11 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665070310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a3e707-3aaf-4af2-ae4d-7f8f21e45bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:10Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Creating volume 34a3e707-3aaf-4af2-ae4d-7f8f21e45bff {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:11 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda1c438-8dae-4d56-8d4c-94b74e57692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf5f780-5662-487a-92d9-1db45a6c4431', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c35c54a-8104-4702-919b-6c090b843838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:11 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff 1073741824 Sep 17 23:58:11 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume volume-9cf5f780-5662-487a-92d9-1db45a6c4431 (9cf5f780-5662-487a-92d9-1db45a6c4431): created successfully Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c35c54a-8104-4702-919b-6c090b843838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (7538f8b1-e35a-4e5e-aa35-95d5a0777ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-00abf8e1-d3f6-46b6-a800-3ab8e117d621 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created volume successfully. Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-63a03821-1a5d-45b9-8067-35b5391072cc tempest-ProjectAdminTests-47641403 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.770751953125, 'free_capacity_gb': 1775.770751953125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85956) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 23:58:12 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff 1073741824" returned: 0 in 0.592s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:12 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff Sep 17 23:58:12 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:12 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28664024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2bd888-11a6-4798-a74c-c5fd721c8bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:11Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Creating volume 8b2bd888-11a6-4798-a74c-c5fd721c8bca {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:12 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe62f57-c64a-4aa7-83cd-16f10d807ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f626e5e-24de-4661-9a77-9b057129da41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:12 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca 1073741824 Sep 17 23:58:12 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:12 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff (34a3e707-3aaf-4af2-ae4d-7f8f21e45bff): created successfully Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f626e5e-24de-4661-9a77-9b057129da41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (215e2cff-eda0-4b81-9ebb-c073b523d976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d0436804-e6ae-4cbc-b3a5-5bffe6ba10e6 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created volume successfully. Sep 17 23:58:13 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca 1073741824" returned: 0 in 0.506s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:13 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca Sep 17 23:58:13 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:13 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca" returned: 0 in 0.353s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.209s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487599317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e510fd-56ca-448e-bfe4-8aef37cfdc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169eb470098644229e926462e82bedc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:11Z,use_quota=True,user_id='76f459683cd24192a1c57881bc6047ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Creating volume 69e510fd-56ca-448e-bfe4-8aef37cfdc65 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:13 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:13 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 1073741824 Sep 17 23:58:13 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Flow 'volume_create_manager' (06fe759c-3c37-4b48-bd5d-40fab927afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452bb017-ebeb-41eb-8038-44fdd959dea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d918af9d-4ba4-4601-9fa2-1f9453a75140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81149cfb-aaca-4e26-8a7d-93ae307347e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452bb017-ebeb-41eb-8038-44fdd959dea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a9e65f-e8a7-494b-a80b-aa4c46154c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb1fd372c44e2e8e2c506f0404aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:14Z,use_quota=True,user_id='0f0ef5b37f1b4c5aa7b8113602e65467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786b84c7-b1d0-4f0a-9fbb-85aa51816102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786b84c7-b1d0-4f0a-9fbb-85aa51816102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6ccd83-ff61-47d6-8a0f-caa5f7f7faf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6ccd83-ff61-47d6-8a0f-caa5f7f7faf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a9e65f-e8a7-494b-a80b-aa4c46154c0a', 'volume_name': 'volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b26d1d9-4ba8-42c6-921c-a42e517496e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b26d1d9-4ba8-42c6-921c-a42e517496e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbbcde0-b6ff-4a5a-8fb0-6371ff86ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Volume 47a9e65f-e8a7-494b-a80b-aa4c46154c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a', 'volume_size': 1} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:13 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca (8b2bd888-11a6-4798-a74c-c5fd721c8bca): created successfully Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81149cfb-aaca-4e26-8a7d-93ae307347e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:13 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (e906e7c4-d8de-4747-93ba-c0efdadc1791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a84a24b8-47da-4f4b-9cf7-aa1240219c3b tempest-CreateVolumesFromSnapshotTest-626607024 None] Created volume successfully. Sep 17 23:58:14 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 1073741824" returned: 0 in 0.554s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:14 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 Sep 17 23:58:14 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:14 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65" returned: 0 in 0.269s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a9e65f-e8a7-494b-a80b-aa4c46154c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb1fd372c44e2e8e2c506f0404aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:14Z,use_quota=True,user_id='0f0ef5b37f1b4c5aa7b8113602e65467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Creating volume 47a9e65f-e8a7-494b-a80b-aa4c46154c0a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:14 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:14 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a 1073741824 Sep 17 23:58:14 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0065e8f1-3f9b-4f88-a751-09a7ffcd0f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2276b87d-3a3f-440d-8698-4cd5f35af660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:14 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Volume volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 (69e510fd-56ca-448e-bfe4-8aef37cfdc65): created successfully Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2276b87d-3a3f-440d-8698-4cd5f35af660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:14 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Flow 'volume_create_manager' (24f581f1-ee14-44a8-8df6-4dd7a4d9412c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8f40fb89-d452-4c15-b440-204488e38e86 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created volume successfully. Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-69e510fd-56ca-448e-bfe4-8aef37cfdc65-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-69e510fd-56ca-448e-bfe4-8aef37cfdc65-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-69e510fd-56ca-448e-bfe4-8aef37cfdc65" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-69e510fd-56ca-448e-bfe4-8aef37cfdc65" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad8c07-b9d7-44fc-a5a7-5cde47207765]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:15 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a 1073741824" returned: 0 in 0.644s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:15 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 Sep 17 23:58:15 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:15 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a Sep 17 23:58:15 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:15 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65" returned: 0 in 0.398s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:15 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65 Sep 17 23:58:15 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:15 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a" returned: 0 in 0.288s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbbcde0-b6ff-4a5a-8fb0-6371ff86ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9545cfc-839a-41bd-a889-f1a2f2fbc867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:15 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Volume volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a (47a9e65f-e8a7-494b-a80b-aa4c46154c0a): created successfully Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9545cfc-839a-41bd-a889-f1a2f2fbc867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Flow 'volume_create_manager' (06fe759c-3c37-4b48-bd5d-40fab927afdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4b2e69b7-ce61-4a6c-a1cb-8a3e11e87d1b tempest-CinderUnicodeTest-338338738 None] Created volume successfully. Sep 17 23:58:15 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-69e510fd-56ca-448e-bfe4-8aef37cfdc65" returned: 0 in 0.263s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-69e510fd-56ca-448e-bfe4-8aef37cfdc65" released by "delete_volume" :: held 0.715s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created reservations ['14790bd1-0113-4c28-9d33-2394bcea6b38', '21231e8c-00f0-4455-bedf-faf029846e5d', '7ecd7250-d6f6-4156-9675-8f0049320aa9', '3e2310b8-f6e4-4b97-aaa0-584e8bf5c02b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:16 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:16 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:16 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-8b2bd888-11a6-4798-a74c-c5fd721c8bca-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.336s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Deleted volume successfully. Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-8b2bd888-11a6-4798-a74c-c5fd721c8bca-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-2dddd2b5-0ce6-4f12-8b60-479cf9e7a0b7 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-69e510fd-56ca-448e-bfe4-8aef37cfdc65-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-8b2bd888-11a6-4798-a74c-c5fd721c8bca" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-8b2bd888-11a6-4798-a74c-c5fd721c8bca" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ff3da-20c9-4dde-81b0-9d9f5c22f7cf]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Flow 'volume_create_manager' (a3cad878-a72c-45a6-99d9-cc4873608b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80be342-ef0e-4bf2-bb91-586b7adf3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80be342-ef0e-4bf2-bb91-586b7adf3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1314341861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56107caa-0a69-406d-bd72-424c3fed4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb1fd372c44e2e8e2c506f0404aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:17Z,use_quota=True,user_id='0f0ef5b37f1b4c5aa7b8113602e65467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40347ed-490e-4646-bba0-ece00ee9afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40347ed-490e-4646-bba0-ece00ee9afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e22ee0-167a-46e5-99f5-6798b359ffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e22ee0-167a-46e5-99f5-6798b359ffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56107caa-0a69-406d-bd72-424c3fed4bdd', 'volume_name': 'volume-56107caa-0a69-406d-bd72-424c3fed4bdd', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b7d3db-b260-48d5-9629-97037f9c73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b7d3db-b260-48d5-9629-97037f9c73ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdf8f6c-d8db-4d01-904f-b218544b71d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:16 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Volume 56107caa-0a69-406d-bd72-424c3fed4bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56107caa-0a69-406d-bd72-424c3fed4bdd', 'volume_size': 1} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1314341861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56107caa-0a69-406d-bd72-424c3fed4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5eb1fd372c44e2e8e2c506f0404aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:17Z,use_quota=True,user_id='0f0ef5b37f1b4c5aa7b8113602e65467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Creating volume 56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:16 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:16 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca Sep 17 23:58:16 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:16 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd 1073741824 Sep 17 23:58:16 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:17 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca" returned: 0 in 0.461s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:17 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca Sep 17 23:58:17 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (0553546b-032a-4256-9519-2d44dcf50901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666ebcef-3fcf-4647-bbae-72b51756a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:17 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd 1073741824" returned: 0 in 0.587s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666ebcef-3fcf-4647-bbae-72b51756a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-954027300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62768996-047e-4aaa-b740-8e8c4e4f83bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:17Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f207efb-9e1c-40d4-840f-650fbba08fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f207efb-9e1c-40d4-840f-650fbba08fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d44177-ec39-4e6e-bcc7-bc63eb8523a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d44177-ec39-4e6e-bcc7-bc63eb8523a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62768996-047e-4aaa-b740-8e8c4e4f83bd', 'volume_name': 'volume-62768996-047e-4aaa-b740-8e8c4e4f83bd', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e227ac-aab3-4db5-8667-5d7c42f57927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e227ac-aab3-4db5-8667-5d7c42f57927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1f6d96-53c7-4a66-8ded-b5c065ed6646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:17 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Volume 62768996-047e-4aaa-b740-8e8c4e4f83bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62768996-047e-4aaa-b740-8e8c4e4f83bd', 'volume_size': 1} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:17 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-8b2bd888-11a6-4798-a74c-c5fd721c8bca" returned: 0 in 0.341s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:17 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd Sep 17 23:58:17 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-8b2bd888-11a6-4798-a74c-c5fd721c8bca" released by "delete_volume" :: held 0.866s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created reservations ['8fe3353a-0d6d-4f4d-af10-de3da56f2a31', '6ed5837e-5599-464a-af1f-6c17a05bb091', 'de03f081-e696-4154-a6e8-c59f8cefb2a9', 'c5a7b6d5-5913-4e05-ad7f-839ad32ab422'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:17 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:17 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:17 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd" returned: 0 in 0.346s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-954027300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62768996-047e-4aaa-b740-8e8c4e4f83bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:17Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Creating volume 62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:17 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff" acquired by "delete_volume" :: waited 0.074s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:17 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd 1073741824 Sep 17 23:58:17 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdf8f6c-d8db-4d01-904f-b218544b71d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56107caa-0a69-406d-bd72-424c3fed4bdd', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a872707-37e1-4004-9845-6ee0998374e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca3b196-ed12-44b9-9a1b-182a6e51feb0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:17 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Volume volume-56107caa-0a69-406d-bd72-424c3fed4bdd (56107caa-0a69-406d-bd72-424c3fed4bdd): created successfully Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a872707-37e1-4004-9845-6ee0998374e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Flow 'volume_create_manager' (a3cad878-a72c-45a6-99d9-cc4873608b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0c5218f1-e3ed-4246-bd4c-f57f1a39de0a tempest-CinderUnicodeTest-338338738 None] Created volume successfully. Sep 17 23:58:17 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.372s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Deleted volume successfully. Sep 17 23:58:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-bee811e0-ae65-44e4-b0e7-e806e04e4982 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-8b2bd888-11a6-4798-a74c-c5fd721c8bca-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:17 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff Sep 17 23:58:17 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:18 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff" returned: 0 in 0.441s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:18 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd 1073741824" returned: 0 in 0.549s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:18 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff Sep 17 23:58:18 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:18 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd Sep 17 23:58:18 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:18 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff" returned: 0 in 0.308s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff" released by "delete_volume" :: held 0.822s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:18 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd" returned: 0 in 0.281s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1f6d96-53c7-4a66-8ded-b5c065ed6646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62768996-047e-4aaa-b740-8e8c4e4f83bd', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7609ea-bcf1-4f1d-bb9d-4b7ca156a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:18 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Volume volume-62768996-047e-4aaa-b740-8e8c4e4f83bd (62768996-047e-4aaa-b740-8e8c4e4f83bd): created successfully Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7609ea-bcf1-4f1d-bb9d-4b7ca156a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (0553546b-032a-4256-9519-2d44dcf50901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:18 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d97712fa-3fbc-4b45-a231-d5bd03d768ac tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Created reservations ['558be572-b013-4ac2-89c1-0a8adad73e87', '4c43a833-f232-412a-8307-54b193c3594f', '26f92a69-5565-4bc2-85e4-316a407f5e2b', '235ce480-3252-4db6-92ea-f01933ae598a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:18 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:18 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Creating offline snapshot fc4120b6-3755-4fb8-941f-82836b698c58 of volume 56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[16583b63-ed78-4613-8eb7-2e8aba637bae]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:19 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.274s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Deleted volume successfully. Sep 17 23:58:19 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d28374f6-00cc-4012-b69b-85a0bafcca9d tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-34a3e707-3aaf-4af2-ae4d-7f8f21e45bff-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:19 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:19 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd" returned: 0 in 0.409s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:19 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 1G Sep 17 23:58:19 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-9cf5f780-5662-487a-92d9-1db45a6c4431-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-9cf5f780-5662-487a-92d9-1db45a6c4431-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-9cf5f780-5662-487a-92d9-1db45a6c4431" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-9cf5f780-5662-487a-92d9-1db45a6c4431" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:20 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 1G" returned: 0 in 0.600s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56107caa-0a69-406d-bd72-424c3fed4bdd -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a96cf3-b143-48fe-a366-f31a5e5a92c9]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:20 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56107caa-0a69-406d-bd72-424c3fed4bdd -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 Sep 17 23:58:20 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:20 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 Sep 17 23:58:20 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:20 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56107caa-0a69-406d-bd72-424c3fed4bdd -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58" returned: 0 in 0.353s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:20 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 is being set with open permissions: ugo+rw Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:20 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 Sep 17 23:58:20 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:20 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431" returned: 0 in 0.428s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:20 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431 Sep 17 23:58:20 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:20 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:20 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.info Sep 17 23:58:20 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:20 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-9cf5f780-5662-487a-92d9-1db45a6c4431" returned: 0 in 0.268s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-9cf5f780-5662-487a-92d9-1db45a6c4431" released by "delete_volume" :: held 0.762s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Created reservations ['9915f536-e147-4a54-b616-9fddaf4690f9', '635d71ef-1e32-4d8d-9a03-a5149574a06f', '827a61cf-3702-4608-b361-197852248183', '90003b8e-1a04-4bfa-b369-f1132e25f035'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:21 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:21 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:21 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.info" returned: 0 in 0.296s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:21 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.info is being set with open permissions: ugo+rw Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:21 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.info Sep 17 23:58:21 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Flow 'volume_create_manager' (e5e7521c-3415-4495-8202-dc37471a1c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4801e-6bb3-47a0-a5e8-c89488446fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-ae541b82-b76b-43d1-b712-20c10a90590c-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4801e-6bb3-47a0-a5e8-c89488446fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894564703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f967b9-5278-4680-9e73-fc75012e85fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1802bc3ce22b487eabc35a8a7534223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:21Z,use_quota=True,user_id='94a811014acf4bc487bf978a3674092e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8db7373-f816-42f7-9670-b0e54df7148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8db7373-f816-42f7-9670-b0e54df7148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea819af2-7ba3-4abf-a780-e1199cd72c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:21 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea819af2-7ba3-4abf-a780-e1199cd72c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f967b9-5278-4680-9e73-fc75012e85fb', 'volume_name': 'volume-a9f967b9-5278-4680-9e73-fc75012e85fb', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f55a6c8-66be-4423-9b45-a10061c66b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f55a6c8-66be-4423-9b45-a10061c66b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538b4878-b474-4cd6-8cd9-d9127edbaa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:21 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Volume a9f967b9-5278-4680-9e73-fc75012e85fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f967b9-5278-4680-9e73-fc75012e85fb', 'volume_size': 1} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-ae541b82-b76b-43d1-b712-20c10a90590c-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.321s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:21 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Deleted volume successfully. Sep 17 23:58:21 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.info" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-40a296ac-54f0-4d68-84ba-f5de75a1c2ba tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-9cf5f780-5662-487a-92d9-1db45a6c4431-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.437s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-ae541b82-b76b-43d1-b712-20c10a90590c" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Creating offline snapshot 211bb868-787e-40f7-aec9-2ffd305169d7 of volume 62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-ae541b82-b76b-43d1-b712-20c10a90590c" acquired by "delete_volume" :: waited 0.031s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a0d22-bd38-4f28-b0e7-9b5c8ac5a873]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:21 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-013bb286-213d-4dd3-aa52-1a491280aeab tempest-CinderUnicodeTest-338338738 None] Create snapshot completed successfully Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[698850bb-63d4-484e-901c-3b428263db7c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:21 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd Sep 17 23:58:21 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:21 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c Sep 17 23:58:21 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:21 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:21 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c" returned: 0 in 0.368s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:21 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 1G Sep 17 23:58:21 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:21 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c Sep 17 23:58:21 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:22 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-ae541b82-b76b-43d1-b712-20c10a90590c" returned: 0 in 0.262s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-ae541b82-b76b-43d1-b712-20c10a90590c" released by "delete_volume" :: held 0.680s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Created reservations ['cf49ea7c-0565-462f-bdca-f3ace391d5a8', '4429dab1-ad01-42cd-ae4b-86e31af4396b', '5fceec09-c995-4b43-bb77-d5da29a4e4a5', '44a04811-5334-4ad3-8e6b-7491301a7d21'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:22 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:22 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Acquiring lock "cinder-fc4120b6-3755-4fb8-941f-82836b698c58-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:22 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 1G" returned: 0 in 0.493s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62768996-047e-4aaa-b740-8e8c4e4f83bd -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Lock "cinder-fc4120b6-3755-4fb8-941f-82836b698c58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Acquiring lock "cinder-quobyte-56107caa-0a69-406d-bd72-424c3fed4bdd" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:22 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62768996-047e-4aaa-b740-8e8c4e4f83bd -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 Sep 17 23:58:22 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-56107caa-0a69-406d-bd72-424c3fed4bdd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Acquiring lock "cinder-quobyte-fc4120b6-3755-4fb8-941f-82836b698c58" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-fc4120b6-3755-4fb8-941f-82836b698c58" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Deleting offline snapshot fc4120b6-3755-4fb8-941f-82836b698c58 of volume 56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] snapshot_file for this snap is: volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[696e1367-ced2-47bf-a3b3-ddfbc5672715]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-894e336f-2546-4461-b096-804ff89ab414-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-894e336f-2546-4461-b096-804ff89ab414-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-7857e954-2766-40fa-9fef-350aa871a187" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-7857e954-2766-40fa-9fef-350aa871a187" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-894e336f-2546-4461-b096-804ff89ab414" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-894e336f-2546-4461-b096-804ff89ab414" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Deleting offline snapshot 894e336f-2546-4461-b096-804ff89ab414 of volume 7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:22 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] snapshot_file for this snap is: volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.316s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9428e-3bc3-497d-9d3c-d9e162452ee7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Deleted volume successfully. Sep 17 23:58:22 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 Sep 17 23:58:22 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d6fb80f9-ab46-4811-913a-0e9705c3a825 tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-ae541b82-b76b-43d1-b712-20c10a90590c-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:22 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62768996-047e-4aaa-b740-8e8c4e4f83bd -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7" returned: 0 in 0.385s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:22 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 is being set with open permissions: ugo+rw Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:22 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 Sep 17 23:58:22 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:22 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 Sep 17 23:58:22 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:22 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58" returned: 0 in 0.421s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56107caa-0a69-406d-bd72-424c3fed4bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc88cc33-c8aa-40ae-82fe-5ec9e0b53b0d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:22 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7" returned: 0 in 0.278s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:22 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd Sep 17 23:58:22 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:22 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414" returned: 0 in 0.456s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7857e954-2766-40fa-9fef-350aa871a187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:23 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.info Sep 17 23:58:23 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dcff9a-af7c-40e3-ae36-6fd8618cdb73]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:23 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 Sep 17 23:58:23 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd" returned: 0 in 0.384s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:23 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.info" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:23 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.info is being set with open permissions: ugo+rw Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:23 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 Sep 17 23:58:23 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.info Sep 17 23:58:23 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187" returned: 0 in 0.391s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:23 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 Sep 17 23:58:23 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.info" returned: 0 in 0.256s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.244s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894564703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f967b9-5278-4680-9e73-fc75012e85fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1802bc3ce22b487eabc35a8a7534223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:21Z,use_quota=True,user_id='94a811014acf4bc487bf978a3674092e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Creating volume a9f967b9-5278-4680-9e73-fc75012e85fb {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:23 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:23 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb 1073741824 Sep 17 23:58:23 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f6884c85-cbf8-434b-8acf-3465e39e2d41 tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:58:23 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58" returned: 0 in 0.381s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:23 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58 Sep 17 23:58:23 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414" returned: 0 in 0.372s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:23 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414 Sep 17 23:58:23 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:23 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd.fc4120b6-3755-4fb8-941f-82836b698c58" returned: 0 in 0.270s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-fc4120b6-3755-4fb8-941f-82836b698c58" released by "_delete_snapshot" :: held 1.596s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:23 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-56107caa-0a69-406d-bd72-424c3fed4bdd" released by "delete_snapshot" :: held 1.623s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Created reservations ['ced860fb-4157-4ff3-a6a6-5ebd2ede1e4a', '5db4c2ae-1120-42ad-9b20-33985d8295a4', '28394feb-1fdc-4a9f-b636-53c1419e5443', 'bf5d8c6c-b3c7-40c3-8b99-72c0f19d3efe'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:24 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb 1073741824" returned: 0 in 0.524s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:24 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187.894e336f-2546-4461-b096-804ff89ab414" returned: 0 in 0.290s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Delete snapshot completed successfully. Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-35c7433e-4d70-4715-9cca-2edbe1ff764a tempest-CinderUnicodeTest-338338738 None] Lock "cinder-fc4120b6-3755-4fb8-941f-82836b698c58-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-211bb868-787e-40f7-aec9-2ffd305169d7-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-894e336f-2546-4461-b096-804ff89ab414" released by "_delete_snapshot" :: held 1.676s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-7857e954-2766-40fa-9fef-350aa871a187" released by "delete_snapshot" :: held 1.713s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:24 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb Sep 17 23:58:24 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Lock "cinder-211bb868-787e-40f7-aec9-2ffd305169d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-62768996-047e-4aaa-b740-8e8c4e4f83bd" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-62768996-047e-4aaa-b740-8e8c4e4f83bd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-211bb868-787e-40f7-aec9-2ffd305169d7" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-211bb868-787e-40f7-aec9-2ffd305169d7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot 211bb868-787e-40f7-aec9-2ffd305169d7 of volume 62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbd200d-4fb7-4257-b209-1cf41a7dd384]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Created reservations ['6dcd7d24-2288-4e24-8271-dc2e1d763c07', 'a0ed20c4-e6c9-4167-b30e-692580a4dce9', 'd5208884-6558-414d-8e98-c41b5bcc9362', '1f6b63ae-3045-4a27-8d64-98313f94b8af'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Delete snapshot completed successfully. Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dedf58da-6985-4c6f-bd4c-7ee694eabf6a tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-894e336f-2546-4461-b096-804ff89ab414-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:24 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 Sep 17 23:58:24 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:24 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb" returned: 0 in 0.276s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538b4878-b474-4cd6-8cd9-d9127edbaa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f967b9-5278-4680-9e73-fc75012e85fb', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71628be3-9d4a-418a-81c2-93acf11bfc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Acquiring lock "cinder-56107caa-0a69-406d-bd72-424c3fed4bdd-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:24 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Volume volume-a9f967b9-5278-4680-9e73-fc75012e85fb (a9f967b9-5278-4680-9e73-fc75012e85fb): created successfully Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71628be3-9d4a-418a-81c2-93acf11bfc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Flow 'volume_create_manager' (e5e7521c-3415-4495-8202-dc37471a1c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Lock "cinder-56107caa-0a69-406d-bd72-424c3fed4bdd-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-7857e954-2766-40fa-9fef-350aa871a187-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d3d06699-4896-4380-acd4-7c554e363ad5 tempest-ProjectReaderTests-87432657 None] Created volume successfully. Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-7857e954-2766-40fa-9fef-350aa871a187-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Acquiring lock "cinder-quobyte-56107caa-0a69-406d-bd72-424c3fed4bdd" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-56107caa-0a69-406d-bd72-424c3fed4bdd" acquired by "delete_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "cinder-quobyte-7857e954-2766-40fa-9fef-350aa871a187" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[600dff05-dcb8-4f38-a7a1-5ee811f341af]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-7857e954-2766-40fa-9fef-350aa871a187" acquired by "delete_volume" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:24 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7" returned: 0 in 0.468s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62768996-047e-4aaa-b740-8e8c4e4f83bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660f8e2-6b6e-470c-900f-f6d5b77d4c28]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab8f20b-5a5f-457f-b90a-3960f7140ea1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:24 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd Sep 17 23:58:24 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:24 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 Sep 17 23:58:24 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:24 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd Sep 17 23:58:24 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:25 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd" returned: 0 in 0.381s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:25 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd Sep 17 23:58:25 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:25 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd" returned: 0 in 0.376s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187" returned: 0 in 0.393s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:25 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 Sep 17 23:58:25 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:25 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187 Sep 17 23:58:25 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:25 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-56107caa-0a69-406d-bd72-424c3fed4bdd" returned: 0 in 0.291s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-56107caa-0a69-406d-bd72-424c3fed4bdd" released by "delete_volume" :: held 0.757s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:25 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Created reservations ['a0528b1a-203f-4cd6-8d7a-01717be484de', 'daa16709-de09-439c-a236-86df7210907e', 'f194bd8c-834f-4478-9b03-3499d06e1679', 'ef6889f4-8f77-448b-9d91-51c3857add5f'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-7857e954-2766-40fa-9fef-350aa871a187" returned: 0 in 0.308s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-quobyte-7857e954-2766-40fa-9fef-350aa871a187" released by "delete_volume" :: held 0.803s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Acquiring lock "cinder-a9f967b9-5278-4680-9e73-fc75012e85fb-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:25 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Lock "cinder-a9f967b9-5278-4680-9e73-fc75012e85fb-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:25 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:25 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7" returned: 0 in 0.499s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Acquiring lock "cinder-47a9e65f-e8a7-494b-a80b-aa4c46154c0a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:25 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7 Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Created reservations ['5482f36d-3288-4ae1-bff1-b3744707b4e0', '83fe45a0-9e80-42fb-9f73-05a5d8f24af6', '11fdb15f-3eb6-4b70-b3a1-9712bffbc7ad', '5d0586d2-3f02-4c82-a185-b673f114747c'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:25 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Lock "cinder-47a9e65f-e8a7-494b-a80b-aa4c46154c0a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Acquiring lock "cinder-quobyte-a9f967b9-5278-4680-9e73-fc75012e85fb" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Lock "cinder-quobyte-a9f967b9-5278-4680-9e73-fc75012e85fb" acquired by "delete_volume" :: waited 0.053s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Acquiring lock "cinder-quobyte-47a9e65f-e8a7-494b-a80b-aa4c46154c0a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435d5dd-d14a-492e-a85f-f5fb519ebb0b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-47a9e65f-e8a7-494b-a80b-aa4c46154c0a" acquired by "delete_volume" :: waited 0.052s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:25 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd.211bb868-787e-40f7-aec9-2ffd305169d7" returned: 0 in 0.295s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.348s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a65e782-e679-4e01-8673-49b33fbbaea1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Deleted volume successfully. Sep 17 23:58:26 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb Sep 17 23:58:26 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:26 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:26 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-211bb868-787e-40f7-aec9-2ffd305169d7" released by "_delete_snapshot" :: held 1.839s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-97d19ae7-c34f-401e-9f1d-485ab4e143ca tempest-CinderUnicodeTest-338338738 None] Lock "cinder-56107caa-0a69-406d-bd72-424c3fed4bdd-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-62768996-047e-4aaa-b740-8e8c4e4f83bd" released by "delete_snapshot" :: held 1.868s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:26 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a Sep 17 23:58:26 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Created reservations ['44ad389b-06b1-48f7-b211-581dc28b868e', '4114fd99-722e-4dc8-b73d-b1bb8bd17492', 'bbb7d4d1-0cf4-4f46-b34e-ef617ebf35fa', '427c6eb5-388e-47dc-95d1-e3e964661bfb'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4cab9ca7-4b14-40b7-b3e1-fcd7c602b002 tempest-ProjectMemberTests-956936783 None] Lock "cinder-211bb868-787e-40f7-aec9-2ffd305169d7-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:26 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-62768996-047e-4aaa-b740-8e8c4e4f83bd-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb" returned: 0 in 0.432s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:26 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Lock "cinder-62768996-047e-4aaa-b740-8e8c4e4f83bd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.369s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:26 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb Sep 17 23:58:26 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Deleted volume successfully. Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-62768996-047e-4aaa-b740-8e8c4e4f83bd" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-862b3ddd-b157-4197-bc6a-d95139106b6b tempest-CreateVolumesFromSnapshotTest-626607024 None] Lock "cinder-7857e954-2766-40fa-9fef-350aa871a187-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-62768996-047e-4aaa-b740-8e8c4e4f83bd" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7895470-b1c9-4798-8465-160832d01d4e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:26 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a" returned: 0 in 0.526s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:26 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a Sep 17 23:58:26 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:26 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd Sep 17 23:58:26 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:26 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a9f967b9-5278-4680-9e73-fc75012e85fb" returned: 0 in 0.296s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Lock "cinder-quobyte-a9f967b9-5278-4680-9e73-fc75012e85fb" released by "delete_volume" :: held 0.802s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Created reservations ['5a68bf52-f0bd-42b6-b3ff-75d6b15185db', '985e3fe1-424c-444d-a1af-71e3bf331fce', '3c93bf30-935e-46f6-b165-1f6c8504ee5c', '0419cd21-8d72-44ae-ba71-3c0e45f94267'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:26 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-47a9e65f-e8a7-494b-a80b-aa4c46154c0a" returned: 0 in 0.333s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Lock "cinder-quobyte-47a9e65f-e8a7-494b-a80b-aa4c46154c0a" released by "delete_volume" :: held 0.930s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:26 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:26 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Created reservations ['c43ff38d-4145-4030-8ad4-815ef4e08465', '0605d1d8-7cad-452c-91de-8d708a8a40ea', 'bce803e3-26c1-4f43-8a4c-ac65037c717d', 'f1e9870c-888a-41ff-9159-b555edbae968'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:26 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd" returned: 0 in 0.477s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:27 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd Sep 17 23:58:27 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:27 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:27 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:27 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Deleted volume successfully. Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-418f0a82-0c9a-405e-a923-1f4776a68c7c tempest-ProjectReaderTests-87432657 None] Lock "cinder-a9f967b9-5278-4680-9e73-fc75012e85fb-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:27 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-62768996-047e-4aaa-b740-8e8c4e4f83bd" returned: 0 in 0.310s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-62768996-047e-4aaa-b740-8e8c4e4f83bd" released by "delete_volume" :: held 0.857s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Created reservations ['736c16be-2088-415f-b01d-fd32d2041b24', 'a0c9ca28-5b78-4f1f-ad7e-08a7e27f0821', '7498ff60-a69b-4dd5-8860-1d490c5e2144', '8d32bcb3-077d-49fd-8d56-8666cc9c066d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:27 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Deleted volume successfully. Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-be21a1ab-38bb-421b-b31a-f9d4d6db4c30 tempest-CinderUnicodeTest-338338738 None] Lock "cinder-47a9e65f-e8a7-494b-a80b-aa4c46154c0a-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:27 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:27 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:27 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.287s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:27 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:58:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-08f88f56-6ccf-497e-8e8e-5dd39780b21b tempest-ProjectMemberTests-956936783 None] Lock "cinder-62768996-047e-4aaa-b740-8e8c4e4f83bd-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=315,cinder:SELECT=210,cinder:INSERT=77,cinder:DELETE=25 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (543d9a5b-470b-47d2-b0bd-6138fe3f737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47284fa5-6384-48ed-8730-9a8a223933c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47284fa5-6384-48ed-8730-9a8a223933c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788051967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74681e52-5624-4e04-b071-600744c49b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:28Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465dfafc-6f19-4348-86d9-077b540b5bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465dfafc-6f19-4348-86d9-077b540b5bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521be8cc-e9c6-4433-928b-45dc799aafe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521be8cc-e9c6-4433-928b-45dc799aafe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74681e52-5624-4e04-b071-600744c49b6f', 'volume_name': 'volume-74681e52-5624-4e04-b071-600744c49b6f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edb54ea-ef53-4ded-826c-e96f4a7a959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edb54ea-ef53-4ded-826c-e96f4a7a959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2470ee2a-b56c-412a-8df7-ef50b7e08945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Volume 74681e52-5624-4e04-b071-600744c49b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74681e52-5624-4e04-b071-600744c49b6f', 'volume_size': 1} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788051967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74681e52-5624-4e04-b071-600744c49b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:28Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Creating volume 74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:28 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:28 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f 1073741824 Sep 17 23:58:28 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=242,cinder:UPDATE=299,cinder:DELETE=29,cinder:INSERT=87 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Flow 'volume_create_manager' (ae1c2402-a435-4c81-9e7f-1b92a76acf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cd5ca5-f004-41fb-98a2-60788cad49df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cd5ca5-f004-41fb-98a2-60788cad49df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573360447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1802bc3ce22b487eabc35a8a7534223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:28Z,use_quota=True,user_id='94a811014acf4bc487bf978a3674092e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d10c728-e784-45ca-844e-a584a21b074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d10c728-e784-45ca-844e-a584a21b074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25706af-eec5-4886-92bf-d3a53a818582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25706af-eec5-4886-92bf-d3a53a818582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc', 'volume_name': 'volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d18204-3eff-4490-ad01-2754a512ecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d18204-3eff-4490-ad01-2754a512ecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7647bb-7e90-4bdd-bd5c-c486b8e00004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:28 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Volume 5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc', 'volume_size': 1} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:28 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f 1073741824" returned: 0 in 0.627s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:28 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f Sep 17 23:58:28 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:29 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f" returned: 0 in 0.309s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573360447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1802bc3ce22b487eabc35a8a7534223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:28Z,use_quota=True,user_id='94a811014acf4bc487bf978a3674092e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Creating volume 5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:29 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2470ee2a-b56c-412a-8df7-ef50b7e08945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74681e52-5624-4e04-b071-600744c49b6f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:29 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc 1073741824 Sep 17 23:58:29 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bc26ba-84a1-49c0-8b64-6fa85ded8924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:29 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Volume volume-74681e52-5624-4e04-b071-600744c49b6f (74681e52-5624-4e04-b071-600744c49b6f): created successfully Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bc26ba-84a1-49c0-8b64-6fa85ded8924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (543d9a5b-470b-47d2-b0bd-6138fe3f737f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:29 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c5d92e48-256c-4f27-b9f0-4e5619fa7ff2 tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:58:29 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc 1073741824" returned: 0 in 0.539s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:29 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc Sep 17 23:58:29 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:30 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc" returned: 0 in 0.300s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7647bb-7e90-4bdd-bd5c-c486b8e00004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b07e65-cdbb-4c77-a680-dedb951d3f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:30 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Volume volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc (5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc): created successfully Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b07e65-cdbb-4c77-a680-dedb951d3f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Flow 'volume_create_manager' (ae1c2402-a435-4c81-9e7f-1b92a76acf9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:30 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6492adf7-17b6-4576-a34b-3eda83eca36a tempest-ProjectReaderTests-87432657 None] Created volume successfully. Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Creating offline snapshot af69076e-a602-4078-8701-03bda82e0aa9 of volume 74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da35d7a-da0d-4d2f-8761-a5db9c92e1ad]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:30 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f Sep 17 23:58:30 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Acquiring lock "cinder-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Lock "cinder-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Acquiring lock "cinder-quobyte-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Lock "cinder-quobyte-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc" acquired by "delete_volume" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:30 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f" returned: 0 in 0.493s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d987433-7ad0-4bfe-b35e-214afd9c5be9]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:30 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 1G Sep 17 23:58:30 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:30 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc Sep 17 23:58:30 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:31 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc" returned: 0 in 0.502s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:31 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc Sep 17 23:58:31 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:31 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 1G" returned: 0 in 0.580s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74681e52-5624-4e04-b071-600744c49b6f -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:31 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74681e52-5624-4e04-b071-600744c49b6f -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 Sep 17 23:58:31 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (963abc00-0b27-4d9a-8e11-60f5fb37bfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a93efef-af87-48ea-a29d-60aed8fd3a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a93efef-af87-48ea-a29d-60aed8fd3a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500369228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3af5810-5f45-4bb1-a4a4-129a8a056a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:31Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a3bc2-4431-4511-94e2-5ac363ef4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a3bc2-4431-4511-94e2-5ac363ef4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17faa17d-443e-485f-bae0-b98909513653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17faa17d-443e-485f-bae0-b98909513653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3af5810-5f45-4bb1-a4a4-129a8a056a55', 'volume_name': 'volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f545a-2d96-4344-98ad-1f7db6f82538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f545a-2d96-4344-98ad-1f7db6f82538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0571413c-69e5-45ed-a207-844e1894aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:31 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Volume b3af5810-5f45-4bb1-a4a4-129a8a056a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55', 'volume_size': 1} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:31 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc" returned: 0 in 0.308s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Lock "cinder-quobyte-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc" released by "delete_volume" :: held 0.872s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Created reservations ['5c3cbd26-eb27-4611-bbe2-677635fda6d5', '4e02f120-a617-470f-9845-ae8f8c998a6c', '6f3c2bee-4cf4-4a3c-a7a1-ce7593ea7a13', 'b1b1490c-2231-4ee8-94eb-2b866bbb52ba'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:31 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74681e52-5624-4e04-b071-600744c49b6f -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9" returned: 0 in 0.328s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:31 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 is being set with open permissions: ugo+rw Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:31 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 Sep 17 23:58:31 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:31 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:31 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:32 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9" returned: 0 in 0.282s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:32 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.info Sep 17 23:58:32 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:32 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.320s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Deleted volume successfully. Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-5ec34293-3996-44a3-87ca-39f10b405ed4 tempest-ProjectReaderTests-87432657 None] Lock "cinder-5edb71c2-7b5b-495c-b3db-d8fbcf4be0fc-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:32 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.info" returned: 0 in 0.319s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:32 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.info is being set with open permissions: ugo+rw Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:32 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.info Sep 17 23:58:32 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:32 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.info" returned: 0 in 0.264s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500369228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3af5810-5f45-4bb1-a4a4-129a8a056a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:31Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Creating volume b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:32 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:32 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 1073741824 Sep 17 23:58:32 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:32 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9ee1860b-b89e-4334-9b62-0dab73cdc141 tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:58:33 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 1073741824" returned: 0 in 0.501s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:33 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 Sep 17 23:58:33 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-af69076e-a602-4078-8701-03bda82e0aa9-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:33 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Lock "cinder-af69076e-a602-4078-8701-03bda82e0aa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-74681e52-5624-4e04-b071-600744c49b6f" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-74681e52-5624-4e04-b071-600744c49b6f" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-af69076e-a602-4078-8701-03bda82e0aa9" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0571413c-69e5-45ed-a207-844e1894aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bbe195-6308-4cdd-941b-1de214a02341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:33 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Volume volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 (b3af5810-5f45-4bb1-a4a4-129a8a056a55): created successfully Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bbe195-6308-4cdd-941b-1de214a02341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (963abc00-0b27-4d9a-8e11-60f5fb37bfcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-af69076e-a602-4078-8701-03bda82e0aa9" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot af69076e-a602-4078-8701-03bda82e0aa9 of volume 74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:33 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d79a50e3-63b3-45b6-a5d0-9f3971d2c049 tempest-ProjectReaderTests-1828984916 None] Created volume successfully. Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e864032-8aa7-4415-8e95-c7b33f1a2046]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:33 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 Sep 17 23:58:33 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:34 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9" returned: 0 in 0.410s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74681e52-5624-4e04-b071-600744c49b6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[08590010-9b20-4ffc-abd8-e3f8aa0c2afd]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:34 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f Sep 17 23:58:34 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:34 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f" returned: 0 in 0.410s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:34 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 Sep 17 23:58:34 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Creating offline snapshot 2c4e8bd1-0126-4463-9b2a-f91c8085d53d of volume b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f57d02-8c2a-4b09-98b2-3c92ceaf0f50]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:35 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9" returned: 0 in 0.518s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:35 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9 Sep 17 23:58:35 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:35 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 Sep 17 23:58:35 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:35 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f.af69076e-a602-4078-8701-03bda82e0aa9" returned: 0 in 0.370s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:35 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55" returned: 0 in 0.501s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-af69076e-a602-4078-8701-03bda82e0aa9" released by "_delete_snapshot" :: held 1.862s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-74681e52-5624-4e04-b071-600744c49b6f" released by "delete_snapshot" :: held 1.945s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:35 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d 1G Sep 17 23:58:35 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Created reservations ['7e62f55a-4439-4c02-9f56-1b4dc3f02b79', '19ce5715-8071-4f69-9767-be8c4e42ba46', '994dc36c-af11-4eeb-94b7-a519e77df164', '02d3d3e0-fdaa-4dc6-b5c6-b5a8e7087a24'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:58:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-968d9315-7f2f-4594-b8d4-72050e89e592 tempest-ProjectMemberTests-956936783 None] Lock "cinder-af69076e-a602-4078-8701-03bda82e0aa9-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:36 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d 1G" returned: 0 in 0.517s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:36 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d Sep 17 23:58:36 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:36 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d" returned: 0 in 0.323s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:36 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d is being set with open permissions: ugo+rw Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:36 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d Sep 17 23:58:36 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:36 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d" returned: 0 in 0.243s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:36 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.info Sep 17 23:58:36 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-74681e52-5624-4e04-b071-600744c49b6f-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Lock "cinder-74681e52-5624-4e04-b071-600744c49b6f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-74681e52-5624-4e04-b071-600744c49b6f" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-74681e52-5624-4e04-b071-600744c49b6f" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:36 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.info" returned: 0 in 0.304s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:36 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.info is being set with open permissions: ugo+rw Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5603f03-da1e-44e9-8c17-f09f658d8812]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:36 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.info Sep 17 23:58:36 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:37 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f Sep 17 23:58:37 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:37 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.info" returned: 0 in 0.266s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-291a17ad-59ec-4fff-a8e2-9a70b0133028 tempest-ProjectReaderTests-1828984916 None] Create snapshot completed successfully Sep 17 23:58:37 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f" returned: 0 in 0.378s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:37 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f Sep 17 23:58:37 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:37 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-74681e52-5624-4e04-b071-600744c49b6f" returned: 0 in 0.271s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-74681e52-5624-4e04-b071-600744c49b6f" released by "delete_volume" :: held 0.721s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Created reservations ['2573e2c7-6eba-440e-a298-36ae60a27975', '7f899a21-0a5a-4988-af95-c5b9965b2160', 'c00c5d55-a86b-4deb-bb29-c33b35b2e436', 'fe040c78-c8fe-400e-b4c5-77d5d886f6c3'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:37 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:37 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:38 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.292s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-962caf52-48fc-435e-8dba-246af0d7c0bd tempest-ProjectMemberTests-956936783 None] Lock "cinder-74681e52-5624-4e04-b071-600744c49b6f-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-2c4e8bd1-0126-4463-9b2a-f91c8085d53d-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-2c4e8bd1-0126-4463-9b2a-f91c8085d53d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-b3af5810-5f45-4bb1-a4a4-129a8a056a55" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b3af5810-5f45-4bb1-a4a4-129a8a056a55" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-2c4e8bd1-0126-4463-9b2a-f91c8085d53d" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (1750c768-dc83-45f5-8fed-fb3a32823b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366c7c1d-ac5d-42f5-a01a-3561617e2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-2c4e8bd1-0126-4463-9b2a-f91c8085d53d" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Deleting offline snapshot 2c4e8bd1-0126-4463-9b2a-f91c8085d53d of volume b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] snapshot_file for this snap is: volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366c7c1d-ac5d-42f5-a01a-3561617e2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177704783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a952d329-16ee-4074-bd32-6094f7648c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:38Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589d033c-7343-4a9f-b124-37632eff7f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589d033c-7343-4a9f-b124-37632eff7f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beeb1a67-79aa-4876-92b0-85bc6a662490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beeb1a67-79aa-4876-92b0-85bc6a662490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a952d329-16ee-4074-bd32-6094f7648c52', 'volume_name': 'volume-a952d329-16ee-4074-bd32-6094f7648c52', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5453ceac-fab4-4dd1-9e71-5e2aa7cce68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5453ceac-fab4-4dd1-9e71-5e2aa7cce68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293485f1-c947-4795-9709-b176089021e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:38 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Volume a952d329-16ee-4074-bd32-6094f7648c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a952d329-16ee-4074-bd32-6094f7648c52', 'volume_size': 1} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177704783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a952d329-16ee-4074-bd32-6094f7648c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:38Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Creating volume a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:38 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd5dc3-f929-4b90-8ab1-448bdf76745f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:38 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 1073741824 Sep 17 23:58:38 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:38 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d Sep 17 23:58:38 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:39 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[08831abc-652e-424d-8dde-75af91842044]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:39 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 1073741824" returned: 0 in 0.558s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:39 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 Sep 17 23:58:39 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:39 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 Sep 17 23:58:39 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:39 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55" returned: 0 in 0.414s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:39 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52" returned: 0 in 0.276s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:39 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d Sep 17 23:58:39 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293485f1-c947-4795-9709-b176089021e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a952d329-16ee-4074-bd32-6094f7648c52', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60634d75-2e84-4d8e-87b9-6e0585732810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:39 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Volume volume-a952d329-16ee-4074-bd32-6094f7648c52 (a952d329-16ee-4074-bd32-6094f7648c52): created successfully Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60634d75-2e84-4d8e-87b9-6e0585732810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (1750c768-dc83-45f5-8fed-fb3a32823b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:39 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-70c8e84a-12a4-4594-9eee-bd417bb203ce tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:58:39 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d" returned: 0 in 0.459s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:40 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d Sep 17 23:58:40 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:40 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55.2c4e8bd1-0126-4463-9b2a-f91c8085d53d" returned: 0 in 0.256s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-2c4e8bd1-0126-4463-9b2a-f91c8085d53d" released by "_delete_snapshot" :: held 1.714s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b3af5810-5f45-4bb1-a4a4-129a8a056a55" released by "delete_snapshot" :: held 1.771s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Created reservations ['5b505681-fedb-4878-9d5c-566d97dd7be4', 'd1a9c16b-f498-44c6-b8d5-db7ec368f000', '773fdee6-cd26-4e54-b383-ef8e05079971', '2169a3df-5e3b-484e-b772-a8cc2f2dec27'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:40 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Delete snapshot completed successfully. Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-91d6a75a-b465-45ae-9d21-e8382051aa93 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-2c4e8bd1-0126-4463-9b2a-f91c8085d53d-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-b3af5810-5f45-4bb1-a4a4-129a8a056a55-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Lock "cinder-b3af5810-5f45-4bb1-a4a4-129a8a056a55-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-b3af5810-5f45-4bb1-a4a4-129a8a056a55" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b3af5810-5f45-4bb1-a4a4-129a8a056a55" acquired by "delete_volume" :: waited 0.036s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c759c99a-5769-4786-86bf-b31ed475311c]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Creating offline snapshot f221a648-bf30-4ca4-9d91-052daae18d28 of volume a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9979ba95-19b8-4274-96a2-96523db7754d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:41 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 Sep 17 23:58:41 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:41 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 Sep 17 23:58:41 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:41 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52" returned: 0 in 0.462s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:41 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55" returned: 0 in 0.541s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:41 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 1G Sep 17 23:58:41 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:41 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55 Sep 17 23:58:41 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:41 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b3af5810-5f45-4bb1-a4a4-129a8a056a55" returned: 0 in 0.298s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b3af5810-5f45-4bb1-a4a4-129a8a056a55" released by "delete_volume" :: held 0.930s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Created reservations ['bf424579-ed60-429f-a1d0-c27aecc44aa7', 'd452771d-3a17-467f-8138-59f4b7471495', '1295a272-d754-4061-802b-b970125bc69b', '7821fd91-9f7b-484c-bc6b-4fada09aeb56'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:41 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 1G" returned: 0 in 0.635s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a952d329-16ee-4074-bd32-6094f7648c52 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:42 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:42 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:42 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a952d329-16ee-4074-bd32-6094f7648c52 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 Sep 17 23:58:42 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:42 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:42 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:42 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.306s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:42 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Deleted volume successfully. Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed58f38b-d52b-47d9-80cd-1ad314e297ad tempest-ProjectReaderTests-1828984916 None] Lock "cinder-b3af5810-5f45-4bb1-a4a4-129a8a056a55-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:42 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a952d329-16ee-4074-bd32-6094f7648c52 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28" returned: 0 in 0.413s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:42 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 is being set with open permissions: ugo+rw Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:42 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 Sep 17 23:58:42 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:42 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.344s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:58:42 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28" returned: 0 in 0.323s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:42 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.info Sep 17 23:58:42 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:43 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.info" returned: 0 in 0.338s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:43 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.info is being set with open permissions: ugo+rw Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:43 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.info Sep 17 23:58:43 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:43 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.info" returned: 0 in 0.366s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.682s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:43 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-917f4286-8e83-4c60-88f2-61e39754e45f tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (d7190591-6fb4-4b5a-b346-d80b8df07176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a8018d-533f-4544-88b9-6af9d22c1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a8018d-533f-4544-88b9-6af9d22c1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412748256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024a7372-d089-44d2-a863-d25a0facdcc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:44Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cfac2f-1fee-4e7f-8401-90a5c8953817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cfac2f-1fee-4e7f-8401-90a5c8953817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b427d94-0353-43ac-9fae-c6c88ded5b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b427d94-0353-43ac-9fae-c6c88ded5b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024a7372-d089-44d2-a863-d25a0facdcc3', 'volume_name': 'volume-024a7372-d089-44d2-a863-d25a0facdcc3', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf762cd-2e9f-4abd-8a71-6bbd5bebaf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf762cd-2e9f-4abd-8a71-6bbd5bebaf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7da0ad-419f-4075-a5dc-576e212358b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:43 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Volume 024a7372-d089-44d2-a863-d25a0facdcc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024a7372-d089-44d2-a863-d25a0facdcc3', 'volume_size': 1} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412748256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024a7372-d089-44d2-a863-d25a0facdcc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:44Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Creating volume 024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:43 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:43 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 1073741824 Sep 17 23:58:43 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-f221a648-bf30-4ca4-9d91-052daae18d28-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Lock "cinder-f221a648-bf30-4ca4-9d91-052daae18d28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-a952d329-16ee-4074-bd32-6094f7648c52" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-a952d329-16ee-4074-bd32-6094f7648c52" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-f221a648-bf30-4ca4-9d91-052daae18d28" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-f221a648-bf30-4ca4-9d91-052daae18d28" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot f221a648-bf30-4ca4-9d91-052daae18d28 of volume a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984825c-a9fe-477a-8a0d-5028927b9443]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:44 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 Sep 17 23:58:44 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:44 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 1073741824" returned: 0 in 0.540s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:44 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 Sep 17 23:58:44 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:44 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28" returned: 0 in 0.436s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a952d329-16ee-4074-bd32-6094f7648c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb84535-21d0-43dd-977d-a38eca1ac7da]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:44 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3" returned: 0 in 0.260s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7da0ad-419f-4075-a5dc-576e212358b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024a7372-d089-44d2-a863-d25a0facdcc3', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043904f5-bcc9-46b4-973e-557649cccce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:44 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Volume volume-024a7372-d089-44d2-a863-d25a0facdcc3 (024a7372-d089-44d2-a863-d25a0facdcc3): created successfully Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043904f5-bcc9-46b4-973e-557649cccce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (d7190591-6fb4-4b5a-b346-d80b8df07176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-3b6f20be-9008-40ae-bacb-0449a9977e70 tempest-ProjectReaderTests-1828984916 None] Created volume successfully. Sep 17 23:58:44 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 Sep 17 23:58:44 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:44 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52" returned: 0 in 0.396s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:45 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 Sep 17 23:58:45 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:45 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28" returned: 0 in 0.380s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:45 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28 Sep 17 23:58:45 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:45 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52.f221a648-bf30-4ca4-9d91-052daae18d28" returned: 0 in 0.261s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-f221a648-bf30-4ca4-9d91-052daae18d28" released by "_delete_snapshot" :: held 1.600s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-a952d329-16ee-4074-bd32-6094f7648c52" released by "delete_snapshot" :: held 1.629s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Created reservations ['1bb20d0a-82ba-432f-b00b-b027f5065b64', '73ddb601-0aaa-4a60-9ba6-2a446252c1e1', '2d352e9e-81b9-4ca9-8db7-dd2f31c60403', '72546a1d-856d-4bfa-a5bc-31b4e5849dc4'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Creating offline snapshot e1de9e5b-7163-4c0b-908f-694a277c3bda of volume 024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[41462317-9e42-45d6-a898-f74849fb57d0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:58:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e18c7b63-95c5-4d41-bcd5-f67535af679b tempest-ProjectMemberTests-956936783 None] Lock "cinder-f221a648-bf30-4ca4-9d91-052daae18d28-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:46 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 Sep 17 23:58:46 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-a952d329-16ee-4074-bd32-6094f7648c52-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Lock "cinder-a952d329-16ee-4074-bd32-6094f7648c52-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-a952d329-16ee-4074-bd32-6094f7648c52" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-a952d329-16ee-4074-bd32-6094f7648c52" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be42b79-a00c-4767-bc39-2a998b8bb2ae]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:46 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3" returned: 0 in 0.418s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:46 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda 1G Sep 17 23:58:46 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:46 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 Sep 17 23:58:46 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:46 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52" returned: 0 in 0.373s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:46 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52 Sep 17 23:58:46 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:46 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda 1G" returned: 0 in 0.444s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:46 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024a7372-d089-44d2-a863-d25a0facdcc3 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:46 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024a7372-d089-44d2-a863-d25a0facdcc3 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda Sep 17 23:58:46 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:47 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a952d329-16ee-4074-bd32-6094f7648c52" returned: 0 in 0.302s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-a952d329-16ee-4074-bd32-6094f7648c52" released by "delete_volume" :: held 0.751s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Created reservations ['c4e01aa9-a7ec-41e0-a06f-2d20081948c6', '816eb357-2d66-43cb-afd8-4a483bedf2c8', '4419ffec-6a5e-4f14-8667-1eee152a5325', '56dee6fd-4b84-401f-89c5-33ca3b9c0153'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:47 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024a7372-d089-44d2-a863-d25a0facdcc3 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda" returned: 0 in 0.394s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:47 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda is being set with open permissions: ugo+rw Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:47 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:47 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:47 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda Sep 17 23:58:47 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:47 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:47 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda" returned: 0 in 0.278s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.295s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:47 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25ea3179-6d67-4792-9e45-1a58e2ebde45 tempest-ProjectMemberTests-956936783 None] Lock "cinder-a952d329-16ee-4074-bd32-6094f7648c52-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:47 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.info Sep 17 23:58:47 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:47 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.info" returned: 0 in 0.299s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:47 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.info is being set with open permissions: ugo+rw Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:47 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.info Sep 17 23:58:47 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (7c28584f-ed36-4755-9cd0-d2a2232058c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f890324-9fac-45a2-b25e-09bbbb921d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f890324-9fac-45a2-b25e-09bbbb921d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022284680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c86eb82-c0d7-4df0-b9b8-1d0356aa8987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:48Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c768984-b62f-4157-8cbd-0d3ee7060adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c768984-b62f-4157-8cbd-0d3ee7060adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c65ff4-1675-48ab-8298-8b954dd1436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c65ff4-1675-48ab-8298-8b954dd1436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c86eb82-c0d7-4df0-b9b8-1d0356aa8987', 'volume_name': 'volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48502c97-ff41-4cb2-aa49-91bf2a91631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48502c97-ff41-4cb2-aa49-91bf2a91631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b95b0e9-8943-424e-a8ba-a2c348d180a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:47 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Volume 1c86eb82-c0d7-4df0-b9b8-1d0356aa8987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987', 'volume_size': 1} Sep 17 23:58:47 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:48 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.info" returned: 0 in 0.261s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022284680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c86eb82-c0d7-4df0-b9b8-1d0356aa8987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:48Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Creating volume 1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:48 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:48 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 1073741824 Sep 17 23:58:48 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f7bafc0e-8041-4bf8-9d8e-91e461e55fc1 tempest-ProjectReaderTests-1828984916 None] Create snapshot completed successfully Sep 17 23:58:48 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 1073741824" returned: 0 in 0.462s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:48 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 Sep 17 23:58:48 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:48 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b95b0e9-8943-424e-a8ba-a2c348d180a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d4ae09-86e0-47bb-bfc9-a6367ac3e4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:48 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Volume volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 (1c86eb82-c0d7-4df0-b9b8-1d0356aa8987): created successfully Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d4ae09-86e0-47bb-bfc9-a6367ac3e4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:48 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (7c28584f-ed36-4755-9cd0-d2a2232058c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:48 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9140ae42-3bcb-4697-9012-425fce9daee9 tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-e1de9e5b-7163-4c0b-908f-694a277c3bda-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Lock "cinder-e1de9e5b-7163-4c0b-908f-694a277c3bda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-024a7372-d089-44d2-a863-d25a0facdcc3" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-024a7372-d089-44d2-a863-d25a0facdcc3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-e1de9e5b-7163-4c0b-908f-694a277c3bda" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-e1de9e5b-7163-4c0b-908f-694a277c3bda" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Deleting offline snapshot e1de9e5b-7163-4c0b-908f-694a277c3bda of volume 024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] snapshot_file for this snap is: volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a073abc-8c74-4271-b42a-d92acae16822]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:49 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda Sep 17 23:58:49 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:49 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda" returned: 0 in 0.432s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-024a7372-d089-44d2-a863-d25a0facdcc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[34803de2-06e7-444b-a236-51f022aece7d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:49 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:49 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 Sep 17 23:58:49 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:50 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3" returned: 0 in 0.436s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:50 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda Sep 17 23:58:50 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Creating offline snapshot a0436c8e-4749-4491-a028-1a3e4bc825bd of volume 1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092c0bf-4d3e-4bb1-a766-3e7d83188498]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:50 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 Sep 17 23:58:50 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:50 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda" returned: 0 in 0.448s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:50 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda Sep 17 23:58:50 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:50 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" returned: 0 in 0.440s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:50 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd 1G Sep 17 23:58:50 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:50 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3.e1de9e5b-7163-4c0b-908f-694a277c3bda" returned: 0 in 0.352s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-e1de9e5b-7163-4c0b-908f-694a277c3bda" released by "_delete_snapshot" :: held 1.798s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:50 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-024a7372-d089-44d2-a863-d25a0facdcc3" released by "delete_snapshot" :: held 1.832s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Created reservations ['78031d0a-fd16-4de5-ba75-ef4f8840b20a', 'ea046ebe-4d14-4a87-b8bb-18ad2057fff5', '1219ddf1-4d54-4f51-be14-7bef89b49fe9', 'e1cc57a8-19d6-4b01-b827-fc1c0254494b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:51 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Delete snapshot completed successfully. Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-00e92646-a79e-4e28-86d7-bf4003f91c3e tempest-ProjectReaderTests-1828984916 None] Lock "cinder-e1de9e5b-7163-4c0b-908f-694a277c3bda-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-024a7372-d089-44d2-a863-d25a0facdcc3-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-024a7372-d089-44d2-a863-d25a0facdcc3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:51 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd 1G" returned: 0 in 0.646s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:51 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd Sep 17 23:58:51 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-024a7372-d089-44d2-a863-d25a0facdcc3" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-024a7372-d089-44d2-a863-d25a0facdcc3" acquired by "delete_volume" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[382372b9-4f38-4145-99ed-a74c2161bccd]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:51 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 Sep 17 23:58:51 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:51 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd" returned: 0 in 0.337s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:51 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd is being set with open permissions: ugo+rw Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:51 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd Sep 17 23:58:51 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:51 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3" returned: 0 in 0.441s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:51 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3 Sep 17 23:58:51 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:51 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:51 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd" returned: 0 in 0.329s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:52 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.info Sep 17 23:58:52 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:52 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-024a7372-d089-44d2-a863-d25a0facdcc3" returned: 0 in 0.300s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-024a7372-d089-44d2-a863-d25a0facdcc3" released by "delete_volume" :: held 0.835s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Created reservations ['8785c063-066e-4352-9190-9101f3281b56', '2d5b4b0e-4ac3-41d0-818b-4a36c180cd54', 'd13694ad-fb0c-4115-81cd-937ac99ff348', '3b7dcf80-b690-40b7-8d54-b3319d5c7389'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:52 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.info" returned: 0 in 0.311s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:52 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.info is being set with open permissions: ugo+rw Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:52 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.info Sep 17 23:58:52 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:52 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:52 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:52 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.info" returned: 0 in 0.341s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:52 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.331s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:52 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Deleted volume successfully. Sep 17 23:58:52 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4c9db842-7d49-44b1-9976-f52c0ddf61ec tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:58:52 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-b402c207-82fa-4b72-a870-ced06693f300 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-024a7372-d089-44d2-a863-d25a0facdcc3-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (9236cac3-f275-4869-a8ee-004d19e67fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9343c711-5370-4fa4-8468-0f52f1be323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9343c711-5370-4fa4-8468-0f52f1be323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014579200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b87412-9b48-4f5a-b510-07148bca9f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:53Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d392b8d0-248e-4f3b-968d-31dcdd50f8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d392b8d0-248e-4f3b-968d-31dcdd50f8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff2ace-968e-47da-9ce4-4eee3460e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff2ace-968e-47da-9ce4-4eee3460e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b87412-9b48-4f5a-b510-07148bca9f27', 'volume_name': 'volume-96b87412-9b48-4f5a-b510-07148bca9f27', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62cf126-013e-43da-bdaa-5a2fba4e4e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62cf126-013e-43da-bdaa-5a2fba4e4e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f668ed3-78da-4bce-9a7a-28890ad6ccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:53 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Volume 96b87412-9b48-4f5a-b510-07148bca9f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b87412-9b48-4f5a-b510-07148bca9f27', 'volume_size': 1} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014579200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b87412-9b48-4f5a-b510-07148bca9f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:53Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Creating volume 96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:53 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:53 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 1073741824 Sep 17 23:58:53 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-a0436c8e-4749-4491-a028-1a3e4bc825bd-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Lock "cinder-a0436c8e-4749-4491-a028-1a3e4bc825bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-a0436c8e-4749-4491-a028-1a3e4bc825bd" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-a0436c8e-4749-4491-a028-1a3e4bc825bd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot a0436c8e-4749-4491-a028-1a3e4bc825bd of volume 1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[099dfd77-9402-47ed-a34f-f93aed921d30]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:53 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd Sep 17 23:58:53 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:53 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 1073741824" returned: 0 in 0.550s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:53 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:53 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 Sep 17 23:58:53 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:54 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd" returned: 0 in 0.556s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cd6bb9-15f7-4427-acaf-ca333e9f1261]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:54 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27" returned: 0 in 0.377s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f668ed3-78da-4bce-9a7a-28890ad6ccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b87412-9b48-4f5a-b510-07148bca9f27', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b237b67c-70de-4e38-af7c-b244e3475ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:54 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Volume volume-96b87412-9b48-4f5a-b510-07148bca9f27 (96b87412-9b48-4f5a-b510-07148bca9f27): created successfully Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b237b67c-70de-4e38-af7c-b244e3475ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (9236cac3-f275-4869-a8ee-004d19e67fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:54 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0c69045c-7b6f-4454-b535-058a49173b95 tempest-ProjectReaderTests-1828984916 None] Created volume successfully. Sep 17 23:58:54 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 Sep 17 23:58:54 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:54 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" returned: 0 in 0.469s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:54 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd Sep 17 23:58:54 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:54 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd" returned: 0 in 0.380s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:54 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd Sep 17 23:58:54 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Flow 'volume_create_manager' (d17a4582-c8be-43be-a548-e061d59d7d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:54 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada4dcad-6d24-4423-8913-ff0c4dfb7525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada4dcad-6d24-4423-8913-ff0c4dfb7525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-53051973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317fa5ea-21ca-41e1-a236-c7725afb6f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62aea937edc94b3dbe775b8cf5d8415b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:55Z,use_quota=True,user_id='a501ff52d6434835ab703171faa767fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d556024c-3692-4800-868d-a60dbb9f1248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d556024c-3692-4800-868d-a60dbb9f1248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374d8ae8-56ff-4178-bea0-47dd91cbb321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374d8ae8-56ff-4178-bea0-47dd91cbb321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317fa5ea-21ca-41e1-a236-c7725afb6f24', 'volume_name': 'volume-317fa5ea-21ca-41e1-a236-c7725afb6f24', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be88efbc-664c-4b96-8662-aedb2a2ade25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be88efbc-664c-4b96-8662-aedb2a2ade25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d54321-a3a1-4809-8022-e31ed4022d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:55 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Volume 317fa5ea-21ca-41e1-a236-c7725afb6f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317fa5ea-21ca-41e1-a236-c7725afb6f24', 'volume_size': 1} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-53051973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317fa5ea-21ca-41e1-a236-c7725afb6f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62aea937edc94b3dbe775b8cf5d8415b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:55Z,use_quota=True,user_id='a501ff52d6434835ab703171faa767fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Creating volume 317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:55 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:55 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 1073741824 Sep 17 23:58:55 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:55 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987.a0436c8e-4749-4491-a028-1a3e4bc825bd" returned: 0 in 0.274s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-a0436c8e-4749-4491-a028-1a3e4bc825bd" released by "_delete_snapshot" :: held 1.808s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" released by "delete_snapshot" :: held 1.836s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Created reservations ['fc6d25ec-9d96-4f63-b930-36d1db0242de', '9c82dee0-05ef-437a-b90c-d37abcd6e5e8', '1ed06a43-b6d0-4d71-ad4e-6e23ee8bee04', '65b65079-eef8-43dd-999e-715afc13c50d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:55 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-dcb3d21b-5908-4c5f-b3ca-188de266e43a tempest-ProjectMemberTests-956936783 None] Lock "cinder-a0436c8e-4749-4491-a028-1a3e4bc825bd-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:55 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 1073741824" returned: 0 in 0.490s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Lock "cinder-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:55 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 Sep 17 23:58:55 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98a76bc-370a-456b-974c-adebe8ce56d8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:55 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 Sep 17 23:58:55 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:55 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24" returned: 0 in 0.250s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.484s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Creating offline snapshot 5e5ced92-23f3-4a5e-a353-29752eaea90f of volume 96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d54321-a3a1-4809-8022-e31ed4022d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317fa5ea-21ca-41e1-a236-c7725afb6f24', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b31fed-5d15-4409-8214-2401ee40c223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22765ba-ebb6-473a-a830-fedd437379f2]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:55 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Volume volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 (317fa5ea-21ca-41e1-a236-c7725afb6f24): created successfully Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b31fed-5d15-4409-8214-2401ee40c223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:55 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Flow 'volume_create_manager' (d17a4582-c8be-43be-a548-e061d59d7d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:55 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-7bc45bba-d695-451e-ae92-de300972dcf0 tempest-SnapshotDependencyTests-366165717 None] Created volume successfully. Sep 17 23:58:56 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 Sep 17 23:58:56 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:56 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" returned: 0 in 0.394s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:56 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987 Sep 17 23:58:56 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:56 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27" returned: 0 in 0.373s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:56 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f 1G Sep 17 23:58:56 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:56 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" returned: 0 in 0.247s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987" released by "delete_volume" :: held 0.716s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Created reservations ['8d0ec63b-6fac-4662-bbe1-eaaedf92f31e', 'e904efed-ce96-4ca3-bea8-0742e8ff4fd4', '657f2059-5bac-46ed-b63d-753e91a0f3a2', '1d73ac50-1a9b-479c-a549-ed8758c59c73'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:56 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:58:56 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:56 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.242s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:56 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f 1G" returned: 0 in 0.417s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b87412-9b48-4f5a-b510-07148bca9f27 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:56 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:58:56 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b87412-9b48-4f5a-b510-07148bca9f27 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f Sep 17 23:58:56 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:56 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a3168a8e-f484-4b02-8aa1-cb0cd35fe124 tempest-ProjectMemberTests-956936783 None] Lock "cinder-1c86eb82-c0d7-4df0-b9b8-1d0356aa8987-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:58:57 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96b87412-9b48-4f5a-b510-07148bca9f27 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f" returned: 0 in 0.372s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:57 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f is being set with open permissions: ugo+rw Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:57 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f Sep 17 23:58:57 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (8d16f035-a4ef-453d-821c-98faeadf3b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3d5e13-2d00-4c59-8c4e-a3b9e52004f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3d5e13-2d00-4c59-8c4e-a3b9e52004f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430664802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26bc76a-8e40-4379-a94f-1f2993273237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:57Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a462320-9daa-4b53-a457-a06f8fa9007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a462320-9daa-4b53-a457-a06f8fa9007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e915d1f-abf7-4f0f-ba15-538bc9b1edce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e915d1f-abf7-4f0f-ba15-538bc9b1edce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26bc76a-8e40-4379-a94f-1f2993273237', 'volume_name': 'volume-d26bc76a-8e40-4379-a94f-1f2993273237', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6683731c-9052-4b51-b783-3c2275313263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6683731c-9052-4b51-b783-3c2275313263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae9e985-14ed-4867-99aa-848922b6a6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:57 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Volume d26bc76a-8e40-4379-a94f-1f2993273237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26bc76a-8e40-4379-a94f-1f2993273237', 'volume_size': 1} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:57 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f" returned: 0 in 0.287s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:57 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.info Sep 17 23:58:57 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:57 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.info" returned: 0 in 0.245s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:57 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.info is being set with open permissions: ugo+rw Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:57 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.info Sep 17 23:58:57 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:57 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.info" returned: 0 in 0.243s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.555s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430664802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26bc76a-8e40-4379-a94f-1f2993273237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:58:57Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Creating volume d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:58:57 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:58:57 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:57 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 1073741824 Sep 17 23:58:57 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:57 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-5ce609b6-58d4-4425-a062-a56ec482049e tempest-ProjectReaderTests-1828984916 None] Create snapshot completed successfully Sep 17 23:58:58 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 1073741824" returned: 0 in 0.401s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:58 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 Sep 17 23:58:58 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-5e5ced92-23f3-4a5e-a353-29752eaea90f-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-5e5ced92-23f3-4a5e-a353-29752eaea90f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-96b87412-9b48-4f5a-b510-07148bca9f27" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-96b87412-9b48-4f5a-b510-07148bca9f27" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-5e5ced92-23f3-4a5e-a353-29752eaea90f" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-5e5ced92-23f3-4a5e-a353-29752eaea90f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Deleting offline snapshot 5e5ced92-23f3-4a5e-a353-29752eaea90f of volume 96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] snapshot_file for this snap is: volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:58:58 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237" returned: 0 in 0.257s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.224s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[4933184c-d2dd-43e3-ba16-1709db417980]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Creating offline snapshot ed18f6ba-fae9-4c31-b502-2674efd3d385 of volume 317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae9e985-14ed-4867-99aa-848922b6a6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26bc76a-8e40-4379-a94f-1f2993273237', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a5dcf3-dd7f-4137-8600-8624a0b6452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[1420bf30-7ea7-45d6-9817-7f04eb814557]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:58 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Volume volume-d26bc76a-8e40-4379-a94f-1f2993273237 (d26bc76a-8e40-4379-a94f-1f2993273237): created successfully Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a5dcf3-dd7f-4137-8600-8624a0b6452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:58:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (8d16f035-a4ef-453d-821c-98faeadf3b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:58:58 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e9730172-a941-4120-b228-1ceacd8e44b1 tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:58:58 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f Sep 17 23:58:58 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:58 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 Sep 17 23:58:58 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:59 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f" returned: 0 in 0.389s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96b87412-9b48-4f5a-b510-07148bca9f27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c676d-2237-42b7-9e08-c338838ba39d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:59 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24" returned: 0 in 0.404s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:59 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 1G Sep 17 23:58:59 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:59 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 Sep 17 23:58:59 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:59 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27" returned: 0 in 0.402s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:59 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f Sep 17 23:58:59 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:58:59 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 1G" returned: 0 in 0.495s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:59 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 Sep 17 23:58:59 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:59 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f" returned: 0 in 0.372s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:59 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f Sep 17 23:58:59 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:58:59 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385" returned: 0 in 0.324s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:58:59 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 is being set with open permissions: ugo+rw Sep 17 23:58:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:58:59 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 Sep 17 23:58:59 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:00 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27.5e5ced92-23f3-4a5e-a353-29752eaea90f" returned: 0 in 0.266s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-5e5ced92-23f3-4a5e-a353-29752eaea90f" released by "_delete_snapshot" :: held 1.539s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-96b87412-9b48-4f5a-b510-07148bca9f27" released by "delete_snapshot" :: held 1.562s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:00 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385" returned: 0 in 0.270s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Created reservations ['76478f65-2129-40f4-afb7-7bd8206b0879', '79935e04-9173-4c68-ba3b-1b7f5fc64d41', '11dec65a-5f5a-4ff0-8125-260a6e7c7b6c', '0680f67c-5b0c-4f17-80ff-4cc240729b9a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:00 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.info Sep 17 23:59:00 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Delete snapshot completed successfully. Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4d2af775-fda1-4491-8222-31f00d3a5563 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-5e5ced92-23f3-4a5e-a353-29752eaea90f-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:00 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.info" returned: 0 in 0.249s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:00 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.info is being set with open permissions: ugo+rw Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:00 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.info Sep 17 23:59:00 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-96b87412-9b48-4f5a-b510-07148bca9f27-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:00 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.info" returned: 0 in 0.248s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.239s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Lock "cinder-96b87412-9b48-4f5a-b510-07148bca9f27-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Creating offline snapshot c6766527-972b-4195-b850-3a88df47cbb4 of volume d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:59:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6c5ce5da-2957-4e2a-992a-5bf493d44f30 tempest-SnapshotDependencyTests-366165717 None] Create snapshot completed successfully Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0689cd25-92d4-4b0f-86ea-97cd14896f2a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-96b87412-9b48-4f5a-b510-07148bca9f27" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-96b87412-9b48-4f5a-b510-07148bca9f27" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2ed0a7-5629-4955-aadd-27ab12e6a08a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:00 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 Sep 17 23:59:00 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:00 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 Sep 17 23:59:00 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:01 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237" returned: 0 in 0.365s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:01 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 1G Sep 17 23:59:01 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:01 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27" returned: 0 in 0.374s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:01 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27 Sep 17 23:59:01 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:01 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-96b87412-9b48-4f5a-b510-07148bca9f27" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-96b87412-9b48-4f5a-b510-07148bca9f27" released by "delete_volume" :: held 0.734s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:01 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 1G" returned: 0 in 0.431s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26bc76a-8e40-4379-a94f-1f2993273237 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:01 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26bc76a-8e40-4379-a94f-1f2993273237 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 Sep 17 23:59:01 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Created reservations ['524e5745-c2b8-48e8-962f-a9883f249f39', '394d036a-5c53-4f3a-a895-730d118e24fb', '07dee4be-50fa-4b61-9a8f-e17de71613b4', '3b4749f5-79f4-48f6-bcc2-744c7e2a4e1d'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:01 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:01 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:01 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26bc76a-8e40-4379-a94f-1f2993273237 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4" returned: 0 in 0.380s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:01 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 is being set with open permissions: ugo+rw Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:01 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 Sep 17 23:59:01 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:01 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.303s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:01 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Deleted volume successfully. Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-db678d83-bae1-4134-99d7-20aaf64dea1c tempest-ProjectReaderTests-1828984916 None] Lock "cinder-96b87412-9b48-4f5a-b510-07148bca9f27-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:02 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4" returned: 0 in 0.332s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:02 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.info Sep 17 23:59:02 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Flow 'volume_create_manager' (5d9c59ae-1830-4535-bcb2-8b8e3a44ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d281edc7-bdef-4c28-9c03-c5ec449028d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d281edc7-bdef-4c28-9c03-c5ec449028d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be238d1a-bfd5-4a33-b92f-1cbaa140a87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62aea937edc94b3dbe775b8cf5d8415b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed18f6ba-fae9-4c31-b502-2674efd3d385,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:02Z,use_quota=True,user_id='a501ff52d6434835ab703171faa767fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf91d25-2207-45d4-b203-95959d70e5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf91d25-2207-45d4-b203-95959d70e5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73014d8-a247-45ae-a907-1f764f563669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73014d8-a247-45ae-a907-1f764f563669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be238d1a-bfd5-4a33-b92f-1cbaa140a87d', 'volume_name': 'volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d', 'volume_size': 1, 'snapshot_id': 'ed18f6ba-fae9-4c31-b502-2674efd3d385'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9c96d0-b540-4b6f-b50d-6808fbf29548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9c96d0-b540-4b6f-b50d-6808fbf29548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7951e2-0838-498a-9943-c464af4eb1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Volume be238d1a-bfd5-4a33-b92f-1cbaa140a87d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d', 'volume_size': 1, 'snapshot_id': 'ed18f6ba-fae9-4c31-b502-2674efd3d385'} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (ce4c3d9f-f8dd-45ba-ad91-d0abd4b08634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7092e5c0-a80e-4927-a28f-2ea64679ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7092e5c0-a80e-4927-a28f-2ea64679ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749241111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e05780-3283-4206-abba-e0fb8b09a09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:02Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9528466-c709-4ead-9e15-04c09060af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9528466-c709-4ead-9e15-04c09060af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea40dcec-6a63-4fc1-a33a-f6b68af312eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea40dcec-6a63-4fc1-a33a-f6b68af312eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e05780-3283-4206-abba-e0fb8b09a09a', 'volume_name': 'volume-b5e05780-3283-4206-abba-e0fb8b09a09a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f5bba3-4387-4935-9a44-e3a27efa2f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f5bba3-4387-4935-9a44-e3a27efa2f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45374989-acc6-4040-9fe5-2028751ef8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:02 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Volume b5e05780-3283-4206-abba-e0fb8b09a09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e05780-3283-4206-abba-e0fb8b09a09a', 'volume_size': 1} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:02 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.info" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:02 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.info is being set with open permissions: ugo+rw Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:02 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.info Sep 17 23:59:02 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:02 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.info" returned: 0 in 0.248s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.414s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-quobyte-ed18f6ba-fae9-4c31-b502-2674efd3d385-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" by "_create_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-ed18f6ba-fae9-4c31-b502-2674efd3d385-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Creating volume be238d1a-bfd5-4a33-b92f-1cbaa140a87d from snapshot ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-quobyte-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" by "_copy_volume_from_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-0b869b09-27f1-4c0c-974d-a606ac2d2ebc tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] snapshot: ed18f6ba-fae9-4c31-b502-2674efd3d385, volume: be238d1a-bfd5-4a33-b92f-1cbaa140a87d, {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f92881-93c1-48dc-88f8-23514b163aff]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:03 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 Sep 17 23:59:03 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:03 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385" returned: 0 in 0.370s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-317fa5ea-21ca-41e1-a236-c7725afb6f24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f8646f-6eec-4e04-95ee-152d9ce3a83a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:03 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 Sep 17 23:59:03 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-c6766527-972b-4195-b850-3a88df47cbb4-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Lock "cinder-c6766527-972b-4195-b850-3a88df47cbb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-d26bc76a-8e40-4379-a94f-1f2993273237" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-d26bc76a-8e40-4379-a94f-1f2993273237" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-c6766527-972b-4195-b850-3a88df47cbb4" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:03 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Creating direct copy from snapshot {{(pid=85956) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.utils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Path /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d not found in is_blk_device check {{(pid=85956) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-c6766527-972b-4195-b850-3a88df47cbb4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot c6766527-972b-4195-b850-3a88df47cbb4 of volume d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:03 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d Sep 17 23:59:03 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba11634-8cde-4a24-8095-63a3689c40d2]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:03 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 Sep 17 23:59:03 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:04 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4" returned: 0 in 0.436s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d26bc76a-8e40-4379-a94f-1f2993273237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:04 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[87397b74-9332-42ce-b6ac-f40dd8ba32db]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:04 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 Sep 17 23:59:04 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:04 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237" returned: 0 in 0.558s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:04 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 Sep 17 23:59:04 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:05 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4" returned: 0 in 0.778s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:05 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4 Sep 17 23:59:05 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:06 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237.c6766527-972b-4195-b850-3a88df47cbb4" returned: 0 in 0.406s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-c6766527-972b-4195-b850-3a88df47cbb4" released by "_delete_snapshot" :: held 2.364s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-d26bc76a-8e40-4379-a94f-1f2993273237" released by "delete_snapshot" :: held 2.401s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:06 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Created reservations ['15d00d5e-8739-499b-8c1b-a87d8de45905', 'd7181f6f-79df-49af-8c9e-7442d353b2d4', 'fb6b8bd1-0162-4435-8f1b-b6b25ea19f35', 'cdb80c31-9092-4b2d-a40b-c4bf8e754a81'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:59:06 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-03b12fcf-635b-47d8-803c-243925421e6e tempest-ProjectMemberTests-956936783 None] Lock "cinder-c6766527-972b-4195-b850-3a88df47cbb4-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-d26bc76a-8e40-4379-a94f-1f2993273237-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Lock "cinder-d26bc76a-8e40-4379-a94f-1f2993273237-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-d26bc76a-8e40-4379-a94f-1f2993273237" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-d26bc76a-8e40-4379-a94f-1f2993273237" acquired by "delete_volume" :: waited 0.035s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[0042794f-ffd6-43f5-af52-b5ebcc7d78e6]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:07 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 Sep 17 23:59:07 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:07 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237" returned: 0 in 0.605s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:07 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237 Sep 17 23:59:07 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:08 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-d26bc76a-8e40-4379-a94f-1f2993273237" returned: 0 in 0.532s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-d26bc76a-8e40-4379-a94f-1f2993273237" released by "delete_volume" :: held 1.262s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Created reservations ['3f08a9e6-b389-461a-9aa4-4274621dfe9d', 'c1942c00-35a7-44ea-b375-a5d00bc6564c', 'ef3393fd-aad9-43e7-9dac-e011e83552ab', '59ade827-a775-49d0-8dea-4f1616b36178'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:08 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:08 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:09 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:09 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.373s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:09 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:09 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:59:09 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-25e5296f-57ff-4c01-b7de-8f87d3e90723 tempest-ProjectMemberTests-956936783 None] Lock "cinder-d26bc76a-8e40-4379-a94f-1f2993273237-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (07d8bdfb-a9d9-41ef-b52c-ff98af2fd51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f9edab-25c2-4995-ae28-4a36175e84f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f9edab-25c2-4995-ae28-4a36175e84f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487374083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97be3dc-4443-4c72-98e0-7d6e91645fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:10Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cfb3d4-d607-4ac8-83c8-98e48f732a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cfb3d4-d607-4ac8-83c8-98e48f732a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdc7d8e-8e02-4b19-b7aa-ac37ba962cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdc7d8e-8e02-4b19-b7aa-ac37ba962cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97be3dc-4443-4c72-98e0-7d6e91645fed', 'volume_name': 'volume-b97be3dc-4443-4c72-98e0-7d6e91645fed', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf0bb64-c818-4980-8dc7-d1a1f3526cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf0bb64-c818-4980-8dc7-d1a1f3526cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d2e30e-a154-4c6f-a997-f222ae28a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Volume b97be3dc-4443-4c72-98e0-7d6e91645fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97be3dc-4443-4c72-98e0-7d6e91645fed', 'volume_size': 1} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:10 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" returned: 0 in 6.718s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.image.image_utils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Image conversion details: src /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d {{(pid=85956) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 23:59:10 devstack cinder-volume[85956]: INFO cinder.image.image_utils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Converted 1024.00 MB image at 152.42 MB/s Sep 17 23:59:10 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d is being set with open permissions: ugo+rw Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:10 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d Sep 17 23:59:10 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:10 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" returned: 0 in 0.235s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" released by "_copy_volume_from_snapshot" :: held 7.793s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-ed18f6ba-fae9-4c31-b502-2674efd3d385-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" released by "_create_volume_from_snapshot" :: held 7.853s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.875s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.205s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749241111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e05780-3283-4206-abba-e0fb8b09a09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:02Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Creating volume b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:10 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:10 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a 1073741824 Sep 17 23:59:10 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7951e2-0838-498a-9943-c464af4eb1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d', 'volume_size': 1, 'snapshot_id': 'ed18f6ba-fae9-4c31-b502-2674efd3d385'}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72654676-4628-444a-b104-83e33043a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:10 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Volume volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d (be238d1a-bfd5-4a33-b92f-1cbaa140a87d): created successfully Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72654676-4628-444a-b104-83e33043a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:10 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Flow 'volume_create_manager' (5d9c59ae-1830-4535-bcb2-8b8e3a44ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:10 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d8bfdb8e-9875-4372-baa0-869f495481c1 tempest-SnapshotDependencyTests-366165717 None] Created volume successfully. Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-ed18f6ba-fae9-4c31-b502-2674efd3d385-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-ed18f6ba-fae9-4c31-b502-2674efd3d385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-quobyte-317fa5ea-21ca-41e1-a236-c7725afb6f24" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-317fa5ea-21ca-41e1-a236-c7725afb6f24" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-quobyte-ed18f6ba-fae9-4c31-b502-2674efd3d385" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-ed18f6ba-fae9-4c31-b502-2674efd3d385" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Deleting offline snapshot ed18f6ba-fae9-4c31-b502-2674efd3d385 of volume 317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] snapshot_file for this snap is: volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d52fc-8571-4816-834d-c682de4db2ec]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:11 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a 1073741824" returned: 0 in 0.486s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:11 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 Sep 17 23:59:11 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:11 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a Sep 17 23:59:11 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:11 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385" returned: 0 in 0.377s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-317fa5ea-21ca-41e1-a236-c7725afb6f24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:11 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487374083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97be3dc-4443-4c72-98e0-7d6e91645fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:10Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Creating volume b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:11 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb0321-1301-41c5-b11d-d271badc2e1b]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:11 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed 1073741824 Sep 17 23:59:11 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45374989-acc6-4040-9fe5-2028751ef8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e05780-3283-4206-abba-e0fb8b09a09a', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42890b43-6a05-4567-aa6f-4dfd656066a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:11 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Volume volume-b5e05780-3283-4206-abba-e0fb8b09a09a (b5e05780-3283-4206-abba-e0fb8b09a09a): created successfully Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42890b43-6a05-4567-aa6f-4dfd656066a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (ce4c3d9f-f8dd-45ba-ad91-d0abd4b08634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:11 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-aa52d020-9ec7-4987-86a4-84586f903ee0 tempest-ProjectReaderTests-1828984916 None] Created volume successfully. Sep 17 23:59:11 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 Sep 17 23:59:11 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:11 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed 1073741824" returned: 0 in 0.421s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:11 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:12 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed Sep 17 23:59:12 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:12 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24" returned: 0 in 0.613s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:12 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 Sep 17 23:59:12 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:12 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d2e30e-a154-4c6f-a997-f222ae28a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97be3dc-4443-4c72-98e0-7d6e91645fed', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f66394-b026-4b39-9e32-56325ab4a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:12 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Volume volume-b97be3dc-4443-4c72-98e0-7d6e91645fed (b97be3dc-4443-4c72-98e0-7d6e91645fed): created successfully Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f66394-b026-4b39-9e32-56325ab4a099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (07d8bdfb-a9d9-41ef-b52c-ff98af2fd51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-89f56883-50cf-43fc-b46f-da819a2bdb05 tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Creating offline snapshot 6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 of volume b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2b11c8-3191-4fb8-85d8-0a1e937f2aa3]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:12 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a Sep 17 23:59:12 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:12 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385" returned: 0 in 0.352s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:12 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385 Sep 17 23:59:12 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:12 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a" returned: 0 in 0.367s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:12 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24.ed18f6ba-fae9-4c31-b502-2674efd3d385" returned: 0 in 0.250s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:12 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 1G Sep 17 23:59:12 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-ed18f6ba-fae9-4c31-b502-2674efd3d385" released by "_delete_snapshot" :: held 1.726s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-317fa5ea-21ca-41e1-a236-c7725afb6f24" released by "delete_snapshot" :: held 1.756s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Created reservations ['965ccabe-f63c-43f5-aba4-d27aa7063582', '0ae38b06-c331-4b09-900e-8fb4c3a2cbcb', 'c9fb5a2c-df07-47b8-a612-dc87799b8302', '09aaf73a-cb8c-4020-9592-d1b2e4f39fda'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:12 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Delete snapshot completed successfully. Sep 17 23:59:12 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-009087fe-4394-4f69-a804-150d3dca2d39 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-ed18f6ba-fae9-4c31-b502-2674efd3d385-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:13 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 1G" returned: 0 in 0.393s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e05780-3283-4206-abba-e0fb8b09a09a -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:13 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e05780-3283-4206-abba-e0fb8b09a09a -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 Sep 17 23:59:13 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-317fa5ea-21ca-41e1-a236-c7725afb6f24-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-317fa5ea-21ca-41e1-a236-c7725afb6f24-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-quobyte-317fa5ea-21ca-41e1-a236-c7725afb6f24" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-317fa5ea-21ca-41e1-a236-c7725afb6f24" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecccc123-6430-47a2-8729-fd2ed57e0972]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:13 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 Sep 17 23:59:13 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:13 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e05780-3283-4206-abba-e0fb8b09a09a -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" returned: 0 in 0.387s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:13 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 is being set with open permissions: ugo+rw Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:13 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 Sep 17 23:59:13 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:13 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24" returned: 0 in 0.383s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:13 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24 Sep 17 23:59:13 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:13 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" returned: 0 in 0.263s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:13 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.info Sep 17 23:59:13 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:13 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:13 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-317fa5ea-21ca-41e1-a236-c7725afb6f24" returned: 0 in 0.255s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-317fa5ea-21ca-41e1-a236-c7725afb6f24" released by "delete_volume" :: held 0.735s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Created reservations ['65401f50-f96a-4613-a106-74097f357971', 'dd365a93-ac9b-4e72-92bf-c47c6eba7dcd', '7302fd90-6e69-4e35-ac27-e66dee80c524', 'ab772d6b-2c00-4cd1-8bd0-f6394fd242d3'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:14 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.info" returned: 0 in 0.266s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:14 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.info is being set with open permissions: ugo+rw Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:14 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.info Sep 17 23:59:14 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:14 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:14 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:14 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.info" returned: 0 in 0.283s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.908s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-be238d1a-bfd5-4a33-b92f-1cbaa140a87d-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:14 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Creating offline snapshot 099671c2-64f8-482a-84fc-023274a7d146 of volume b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.293s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-be238d1a-bfd5-4a33-b92f-1cbaa140a87d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[d528e095-a806-4057-91b6-0d48976a947f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Deleted volume successfully. Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:14 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-21052658-ece7-49da-bc8d-c8ddaeacdf5a tempest-ProjectReaderTests-1828984916 None] Create snapshot completed successfully Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-12e2482c-5e2e-4ffa-ba14-ffaa14294826 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-317fa5ea-21ca-41e1-a236-c7725afb6f24-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "cinder-quobyte-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b246820-f35c-4acc-aa84-031d283c49e0]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:14 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed Sep 17 23:59:14 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:14 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d Sep 17 23:59:14 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:14 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed" returned: 0 in 0.374s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:14 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 1G Sep 17 23:59:14 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:14 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" returned: 0 in 0.378s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:14 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:14 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d Sep 17 23:59:14 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:15 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:15 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" returned: 0 in 0.297s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 1G" returned: 0 in 0.412s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97be3dc-4443-4c72-98e0-7d6e91645fed -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-quobyte-be238d1a-bfd5-4a33-b92f-1cbaa140a87d" released by "delete_volume" :: held 0.727s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:15 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97be3dc-4443-4c72-98e0-7d6e91645fed -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 Sep 17 23:59:15 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Created reservations ['2ad4ad21-1022-44dc-a6a9-55ed4f33d2df', 'b9d34b70-6cad-409d-96cb-c0d4554983f1', '83e317a9-491e-4744-92eb-669c3e11171d', 'fef7acd9-3c95-4f82-8dac-4ecdbe713bd5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:15 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:15 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-6e857c7e-ba69-4a9a-84ed-a3738f0c17e2-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Lock "cinder-6e857c7e-ba69-4a9a-84ed-a3738f0c17e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-b5e05780-3283-4206-abba-e0fb8b09a09a" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b5e05780-3283-4206-abba-e0fb8b09a09a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Deleting offline snapshot 6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 of volume b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] snapshot_file for this snap is: volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[f185920e-a1c2-4e28-8735-46f61517408f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:15 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97be3dc-4443-4c72-98e0-7d6e91645fed -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146" returned: 0 in 0.405s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:15 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 is being set with open permissions: ugo+rw Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:15 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.334s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:15 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 Sep 17 23:59:15 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:15 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Deleted volume successfully. Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-99fff9dd-b47a-424c-91f4-64d09bc5eea5 tempest-SnapshotDependencyTests-366165717 None] Lock "cinder-be238d1a-bfd5-4a33-b92f-1cbaa140a87d-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:15 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 Sep 17 23:59:15 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:15 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146" returned: 0 in 0.273s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:15 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:15 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.info Sep 17 23:59:15 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:16 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" returned: 0 in 0.407s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e05780-3283-4206-abba-e0fb8b09a09a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c011d87-946d-4c90-b8f0-78d80d60bd1e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:16 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a Sep 17 23:59:16 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:16 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.info" returned: 0 in 0.271s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:16 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.info is being set with open permissions: ugo+rw Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:16 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.info Sep 17 23:59:16 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:16 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a" returned: 0 in 0.415s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:16 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:16 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 Sep 17 23:59:16 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.info" returned: 0 in 0.303s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:16 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-864c2b15-336f-4762-a454-4e153586d9e9 tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:59:16 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" returned: 0 in 0.371s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:16 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:16 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2 Sep 17 23:59:16 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:17 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a.6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" returned: 0 in 0.277s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-6e857c7e-ba69-4a9a-84ed-a3738f0c17e2" released by "_delete_snapshot" :: held 1.597s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b5e05780-3283-4206-abba-e0fb8b09a09a" released by "delete_snapshot" :: held 1.621s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Created reservations ['b5052282-56db-4ff1-8472-a8aa3b43a01a', '334f64fa-6ae1-4b5b-990d-1c60fe52c13d', 'a496319d-4446-4cad-a697-de029f4dd0df', 'd806f4c9-5187-4eac-ba2f-c42627a6f16b'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:17 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Delete snapshot completed successfully. Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ce3afbe3-c74d-4004-936c-e541ca6947ce tempest-ProjectReaderTests-1828984916 None] Lock "cinder-6e857c7e-ba69-4a9a-84ed-a3738f0c17e2-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-b5e05780-3283-4206-abba-e0fb8b09a09a-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-b5e05780-3283-4206-abba-e0fb8b09a09a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-099671c2-64f8-482a-84fc-023274a7d146-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-b5e05780-3283-4206-abba-e0fb8b09a09a" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Lock "cinder-099671c2-64f8-482a-84fc-023274a7d146-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-b97be3dc-4443-4c72-98e0-7d6e91645fed" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b5e05780-3283-4206-abba-e0fb8b09a09a" acquired by "delete_volume" :: waited 0.037s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-b97be3dc-4443-4c72-98e0-7d6e91645fed" acquired by "delete_snapshot" :: waited 0.058s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-099671c2-64f8-482a-84fc-023274a7d146" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-099671c2-64f8-482a-84fc-023274a7d146" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot 099671c2-64f8-482a-84fc-023274a7d146 of volume b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[b846e025-1a7e-4d4b-abc4-a3e173c5c534]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[49640ac1-657f-4e1b-9f86-2aa5994ad28f]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:17 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:18 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a Sep 17 23:59:18 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:18 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 Sep 17 23:59:18 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:18 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a" returned: 0 in 0.409s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:18 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146" returned: 0 in 0.411s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97be3dc-4443-4c72-98e0-7d6e91645fed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:18 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a Sep 17 23:59:18 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[da602ef6-58a0-4316-bce6-241de2c5de71]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:18 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed Sep 17 23:59:18 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:18 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b5e05780-3283-4206-abba-e0fb8b09a09a" returned: 0 in 0.250s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-b5e05780-3283-4206-abba-e0fb8b09a09a" released by "delete_volume" :: held 0.764s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Created reservations ['7ff8a062-d095-4983-a729-9f3ee4754f0a', 'afc9f283-a361-4f49-83fc-83626948a56c', '02636239-aa7e-46a0-8263-1a3ca08ad6be', 'fbfeea9d-ee02-4dd5-890d-059f7eba55b0'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:18 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:18 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:18 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed" returned: 0 in 0.381s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:18 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:18 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 Sep 17 23:59:18 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:18 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.289s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Deleted volume successfully. Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e04c0b28-0a36-473c-b1f7-c68b35737a28 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-b5e05780-3283-4206-abba-e0fb8b09a09a-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:19 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146" returned: 0 in 0.455s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:19 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146 Sep 17 23:59:19 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (53f5dc07-3fbe-4194-9225-62647487fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c1ade7-d373-4efc-99f7-42ead6eac828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:19 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c1ade7-d373-4efc-99f7-42ead6eac828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263196293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51eccf1-0e07-4765-860c-df13ff504e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:19Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73d1154-b070-4455-9cb8-dd6dc60faa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73d1154-b070-4455-9cb8-dd6dc60faa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76ed39c-bf39-4887-9de4-8fe39dea29a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76ed39c-bf39-4887-9de4-8fe39dea29a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51eccf1-0e07-4765-860c-df13ff504e4b', 'volume_name': 'volume-a51eccf1-0e07-4765-860c-df13ff504e4b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6011262-b99c-4576-90db-877271402f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6011262-b99c-4576-90db-877271402f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f42115-340f-42b1-a67a-544e43a985e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:19 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Volume a51eccf1-0e07-4765-860c-df13ff504e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51eccf1-0e07-4765-860c-df13ff504e4b', 'volume_size': 1} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263196293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51eccf1-0e07-4765-860c-df13ff504e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f8dd58a7d642d0abe6bd5e99a1e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:19Z,use_quota=True,user_id='ca4fe7f6880f47b29481e5925e174c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Creating volume a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:19 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed.099671c2-64f8-482a-84fc-023274a7d146" returned: 0 in 0.358s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:19 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b 1073741824 Sep 17 23:59:19 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-099671c2-64f8-482a-84fc-023274a7d146" released by "_delete_snapshot" :: held 1.728s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-b97be3dc-4443-4c72-98e0-7d6e91645fed" released by "delete_snapshot" :: held 1.752s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Created reservations ['3aa482e6-3a4e-4665-bf97-18259a8ca700', '679f77f2-5430-445b-8be8-ab0da85253a0', 'efb507bc-752c-49e3-a938-f709e4bcbc45', '98ff3e1c-a666-4554-9ef0-e4ed6d1c973a'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:19 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-c15418a0-a0bc-4c4e-98e2-eed6fa227931 tempest-ProjectMemberTests-956936783 None] Lock "cinder-099671c2-64f8-482a-84fc-023274a7d146-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:19 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-b97be3dc-4443-4c72-98e0-7d6e91645fed-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Lock "cinder-b97be3dc-4443-4c72-98e0-7d6e91645fed-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-b97be3dc-4443-4c72-98e0-7d6e91645fed" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-b97be3dc-4443-4c72-98e0-7d6e91645fed" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e7e15-3e6d-42f9-b72a-905743250e50]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:20 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b 1073741824" returned: 0 in 0.638s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:20 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b Sep 17 23:59:20 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:20 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed Sep 17 23:59:20 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:20 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b" returned: 0 in 0.276s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f42115-340f-42b1-a67a-544e43a985e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51eccf1-0e07-4765-860c-df13ff504e4b', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e094da03-860c-41d5-8b47-f70d308a4a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:20 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Volume volume-a51eccf1-0e07-4765-860c-df13ff504e4b (a51eccf1-0e07-4765-860c-df13ff504e4b): created successfully Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e094da03-860c-41d5-8b47-f70d308a4a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Flow 'volume_create_manager' (53f5dc07-3fbe-4194-9225-62647487fd50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:20 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-d37738ec-e442-4204-baf7-5e1fa0f4e952 tempest-ProjectReaderTests-1828984916 None] Created volume successfully. Sep 17 23:59:20 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed" returned: 0 in 0.408s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:20 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed Sep 17 23:59:20 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:20 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-b97be3dc-4443-4c72-98e0-7d6e91645fed" returned: 0 in 0.295s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-b97be3dc-4443-4c72-98e0-7d6e91645fed" released by "delete_volume" :: held 0.776s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:20 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Created reservations ['ee1af787-05f8-42bd-8212-01f06652edd4', '5d2c590d-1472-4039-be2d-073ebd99d00b', '20586f1a-449a-4207-80f8-642d3fa0f9cd', '994ea690-fe22-4fd5-b9d4-0cd7edf2cd15'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:21 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:21 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:21 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.264s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:21 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-a2c7cf93-67f8-4a34-a48a-54417404a549 tempest-ProjectMemberTests-956936783 None] Lock "cinder-b97be3dc-4443-4c72-98e0-7d6e91645fed-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (16539c1c-4b5c-4e9a-8cf9-ff5aaab22481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c1452a-e2cd-430a-a7ab-bd74e0ce5939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c1452a-e2cd-430a-a7ab-bd74e0ce5939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977577398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4053fbf9-b164-4775-93a9-5cc5215ffb12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:22Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bdf2f6-9f5c-45e5-b02d-2756350109f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bdf2f6-9f5c-45e5-b02d-2756350109f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5da129-6cbc-4526-8d55-ac33454389fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5da129-6cbc-4526-8d55-ac33454389fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4053fbf9-b164-4775-93a9-5cc5215ffb12', 'volume_name': 'volume-4053fbf9-b164-4775-93a9-5cc5215ffb12', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326d176-c79a-46bf-a8a1-86ba2e64609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326d176-c79a-46bf-a8a1-86ba2e64609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c53a8a-0f8b-4ba4-8801-845b8fdb8371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:21 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Volume 4053fbf9-b164-4775-93a9-5cc5215ffb12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4053fbf9-b164-4775-93a9-5cc5215ffb12', 'volume_size': 1} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977577398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4053fbf9-b164-4775-93a9-5cc5215ffb12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:22Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Creating volume 4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:21 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:21 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:21 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 1073741824 Sep 17 23:59:21 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:22 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 1073741824" returned: 0 in 0.490s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:22 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 Sep 17 23:59:22 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:22 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12" returned: 0 in 0.250s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.755s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c53a8a-0f8b-4ba4-8801-845b8fdb8371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4053fbf9-b164-4775-93a9-5cc5215ffb12', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12eb0421-088f-4540-a41f-598a0782aba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Creating offline snapshot a0c2c728-9cd1-4baa-af06-333a1dc12b16 of volume a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:59:22 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Volume volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 (4053fbf9-b164-4775-93a9-5cc5215ffb12): created successfully Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12eb0421-088f-4540-a41f-598a0782aba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (16539c1c-4b5c-4e9a-8cf9-ff5aaab22481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f9e96-c064-40ce-88f6-8d427fc2cb13]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:22 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:22 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-bd28e272-b798-403f-823b-8e3c34ff5eeb tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:59:22 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b Sep 17 23:59:22 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:23 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b" returned: 0 in 0.373s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:23 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 1G Sep 17 23:59:23 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:23 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 1G" returned: 0 in 0.417s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51eccf1-0e07-4765-860c-df13ff504e4b -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:23 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51eccf1-0e07-4765-860c-df13ff504e4b -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 Sep 17 23:59:23 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:23 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51eccf1-0e07-4765-860c-df13ff504e4b -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16" returned: 0 in 0.302s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:23 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 is being set with open permissions: ugo+rw Sep 17 23:59:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:23 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 Sep 17 23:59:23 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:23 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:24 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16" returned: 0 in 0.271s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:24 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.info Sep 17 23:59:24 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:24 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.info" returned: 0 in 0.319s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:24 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.info is being set with open permissions: ugo+rw Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:24 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.info Sep 17 23:59:24 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:24 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.info" returned: 0 in 0.252s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.738s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Creating offline snapshot e30b8094-c405-4b63-bd1a-d5336953b612 of volume 4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:59:24 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f22ab957-dc06-4229-807a-88a0f3da20c0 tempest-ProjectReaderTests-1828984916 None] Create snapshot completed successfully Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8d626-3c8c-4b64-a8f6-32b4847b2357]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:24 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:24 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 Sep 17 23:59:24 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-a0c2c728-9cd1-4baa-af06-333a1dc12b16-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-a0c2c728-9cd1-4baa-af06-333a1dc12b16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-a51eccf1-0e07-4765-860c-df13ff504e4b" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-a51eccf1-0e07-4765-860c-df13ff504e4b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-a0c2c728-9cd1-4baa-af06-333a1dc12b16" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-a0c2c728-9cd1-4baa-af06-333a1dc12b16" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Deleting offline snapshot a0c2c728-9cd1-4baa-af06-333a1dc12b16 of volume a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] snapshot_file for this snap is: volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fabc5b-c180-4993-9ba5-5502af84b116]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:25 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12" returned: 0 in 0.438s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:25 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 1G Sep 17 23:59:25 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:25 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 Sep 17 23:59:25 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:25 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16" returned: 0 in 0.402s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a51eccf1-0e07-4765-860c-df13ff504e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ed07f-96fe-4a30-8430-ff4c4ddff5d6]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:25 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 1G" returned: 0 in 0.505s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:25 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:25 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b Sep 17 23:59:25 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:25 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 Sep 17 23:59:25 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:26 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:26 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b" returned: 0 in 0.424s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612" returned: 0 in 0.340s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:26 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 is being set with open permissions: ugo+rw Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:26 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 Sep 17 23:59:26 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:26 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 Sep 17 23:59:26 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:26 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612" returned: 0 in 0.275s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:26 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.info Sep 17 23:59:26 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:26 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16" returned: 0 in 0.420s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:26 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16 Sep 17 23:59:26 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:26 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.info" returned: 0 in 0.286s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:26 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.info is being set with open permissions: ugo+rw Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:26 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.info Sep 17 23:59:26 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:26 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b.a0c2c728-9cd1-4baa-af06-333a1dc12b16" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-a0c2c728-9cd1-4baa-af06-333a1dc12b16" released by "_delete_snapshot" :: held 1.662s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-a51eccf1-0e07-4765-860c-df13ff504e4b" released by "delete_snapshot" :: held 1.697s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Created reservations ['b659d227-cfce-4572-bae7-2c1730d3f1d5', 'a834d5c8-7e25-40d8-996b-0f57a1689d08', '9da0f90a-4ebc-40e2-81c3-705ff9f1e548', '48240513-fdd6-4fa8-b071-fa8a1757bcfb'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:26 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.info" returned: 0 in 0.280s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-2d8a0ac5-99ea-4cbf-9282-58fd7c5aaa98 tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:59:26 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Delete snapshot completed successfully. Sep 17 23:59:26 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-4b90a2f9-3afc-4f1b-b262-398f0f01c105 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-a0c2c728-9cd1-4baa-af06-333a1dc12b16-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-e30b8094-c405-4b63-bd1a-d5336953b612-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Lock "cinder-e30b8094-c405-4b63-bd1a-d5336953b612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-4053fbf9-b164-4775-93a9-5cc5215ffb12" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-4053fbf9-b164-4775-93a9-5cc5215ffb12" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-e30b8094-c405-4b63-bd1a-d5336953b612" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-a51eccf1-0e07-4765-860c-df13ff504e4b-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-e30b8094-c405-4b63-bd1a-d5336953b612" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot e30b8094-c405-4b63-bd1a-d5336953b612 of volume 4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-a51eccf1-0e07-4765-860c-df13ff504e4b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[6034086e-536e-47b7-ad52-a8af1ff09dc1]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "cinder-quobyte-a51eccf1-0e07-4765-860c-df13ff504e4b" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-a51eccf1-0e07-4765-860c-df13ff504e4b" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67cfe09-5e4b-4440-84c0-de23d03a169e]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:27 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 Sep 17 23:59:27 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:27 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b Sep 17 23:59:27 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:27 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612" returned: 0 in 0.407s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4053fbf9-b164-4775-93a9-5cc5215ffb12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[91af51df-a5a8-49c7-87c6-4232033527f8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:27 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b" returned: 0 in 0.372s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:27 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:27 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b Sep 17 23:59:27 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:27 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 Sep 17 23:59:27 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:28 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-a51eccf1-0e07-4765-860c-df13ff504e4b" returned: 0 in 0.256s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-quobyte-a51eccf1-0e07-4765-860c-df13ff504e4b" released by "delete_volume" :: held 0.698s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=211,cinder:SELECT=167,cinder:DELETE=22,cinder:INSERT=57 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Created reservations ['52dce8e2-9925-4265-a2de-be22dd77bd21', '0a148579-f452-4d5b-803f-6cde05bf14df', '8e27cc52-1388-449d-9499-2585df96bbc0', '1d66dd20-1de3-48cc-a8ee-fe4763208c09'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:28 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12" returned: 0 in 0.376s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:28 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 Sep 17 23:59:28 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:28 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:28 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:28 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.250s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Deleted volume successfully. Sep 17 23:59:28 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-47683e5a-cdab-4041-a65e-0ce6ab468099 tempest-ProjectReaderTests-1828984916 None] Lock "cinder-a51eccf1-0e07-4765-860c-df13ff504e4b-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612" returned: 0 in 0.356s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:28 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612 Sep 17 23:59:28 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:28 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12.e30b8094-c405-4b63-bd1a-d5336953b612" returned: 0 in 0.252s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-e30b8094-c405-4b63-bd1a-d5336953b612" released by "_delete_snapshot" :: held 1.530s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-4053fbf9-b164-4775-93a9-5cc5215ffb12" released by "delete_snapshot" :: held 1.565s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=232,cinder:SELECT=183,cinder:INSERT=65,cinder:DELETE=17 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Created reservations ['1113eb16-8112-46d1-9dcd-f4050a3e672b', 'c2224b05-a630-47d9-93f0-ced9c4df095e', 'd9980918-26c2-4728-b0f6-37bb896ec253', 'c1a3d713-f995-454f-822f-b54433d572fa'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:28 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:59:28 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-6bfe4419-0c1d-4fa6-b70b-3e74bcb0e17e tempest-ProjectMemberTests-956936783 None] Lock "cinder-e30b8094-c405-4b63-bd1a-d5336953b612-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-4053fbf9-b164-4775-93a9-5cc5215ffb12-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Lock "cinder-4053fbf9-b164-4775-93a9-5cc5215ffb12-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-4053fbf9-b164-4775-93a9-5cc5215ffb12" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-4053fbf9-b164-4775-93a9-5cc5215ffb12" acquired by "delete_volume" :: waited 0.017s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c8a76-c685-4ae0-8368-dc2bf71fc0db]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:29 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 Sep 17 23:59:29 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:29 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12" returned: 0 in 0.413s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:29 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:29 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12 Sep 17 23:59:29 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:30 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-4053fbf9-b164-4775-93a9-5cc5215ffb12" returned: 0 in 0.267s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-4053fbf9-b164-4775-93a9-5cc5215ffb12" released by "delete_volume" :: held 0.754s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Created reservations ['0fe0a048-58a1-4d98-b66d-cd74a2cbcfc9', '0c98ec08-9315-4fcd-90ce-7180706ddefb', '4250a92c-c307-4404-a8f4-b72d77f0b280', '53192c42-b144-4e20-a361-3a0cfe8b0696'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:30 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:30 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:30 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.254s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:30 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:59:30 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-525add70-fdd2-48ae-b85f-9ab6c678764d tempest-ProjectMemberTests-956936783 None] Lock "cinder-4053fbf9-b164-4775-93a9-5cc5215ffb12-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (4b70aa8b-5f33-44b4-95b1-e888b7d6e7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbee62a-3555-49f6-af53-0ecb79625fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbee62a-3555-49f6-af53-0ecb79625fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090592682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407e369d-4e56-431f-b1f1-d83503c12c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:31Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ed83e4-bc44-48e9-97dc-ef2c9c5c3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ed83e4-bc44-48e9-97dc-ef2c9c5c3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0c6263-b5ca-480b-931f-54e0e5b042f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0c6263-b5ca-480b-931f-54e0e5b042f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407e369d-4e56-431f-b1f1-d83503c12c0f', 'volume_name': 'volume-407e369d-4e56-431f-b1f1-d83503c12c0f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d686bf7-2587-4605-8692-75ec98584339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d686bf7-2587-4605-8692-75ec98584339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b40590-a34b-413c-b0da-9de53df0c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:31 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Volume 407e369d-4e56-431f-b1f1-d83503c12c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407e369d-4e56-431f-b1f1-d83503c12c0f', 'volume_size': 1} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090592682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407e369d-4e56-431f-b1f1-d83503c12c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:31Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Creating volume 407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:31 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:31 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f 1073741824 Sep 17 23:59:31 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:31 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f 1073741824" returned: 0 in 0.431s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:31 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f Sep 17 23:59:31 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:31 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f" returned: 0 in 0.261s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b40590-a34b-413c-b0da-9de53df0c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407e369d-4e56-431f-b1f1-d83503c12c0f', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0574cf-713b-4396-afff-e9cd4eb893ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:31 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Volume volume-407e369d-4e56-431f-b1f1-d83503c12c0f (407e369d-4e56-431f-b1f1-d83503c12c0f): created successfully Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0574cf-713b-4396-afff-e9cd4eb893ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:31 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (4b70aa8b-5f33-44b4-95b1-e888b7d6e7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:31 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-34588b29-d435-40fb-a4f5-61bb9f889ccf tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Creating offline snapshot c9851ccd-751e-4e67-8ffa-c95e1b552ea6 of volume 407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[2627e53c-f45c-48e0-b63a-c30721d0ec3d]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:32 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f Sep 17 23:59:32 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:32 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f" returned: 0 in 0.352s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:32 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 1G Sep 17 23:59:32 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:32 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 1G" returned: 0 in 0.404s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:32 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407e369d-4e56-431f-b1f1-d83503c12c0f -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:32 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407e369d-4e56-431f-b1f1-d83503c12c0f -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 Sep 17 23:59:32 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:33 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407e369d-4e56-431f-b1f1-d83503c12c0f -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6" returned: 0 in 0.311s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:33 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 is being set with open permissions: ugo+rw Sep 17 23:59:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:33 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 Sep 17 23:59:33 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:33 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6" returned: 0 in 0.266s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:33 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.info Sep 17 23:59:33 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:33 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.info" returned: 0 in 0.247s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:33 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.info is being set with open permissions: ugo+rw Sep 17 23:59:33 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:33 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.info Sep 17 23:59:33 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:34 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.info" returned: 0 in 0.241s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:34 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-21895570-f47c-4f3f-921f-c5e3f438b84c tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-c9851ccd-751e-4e67-8ffa-c95e1b552ea6-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Lock "cinder-c9851ccd-751e-4e67-8ffa-c95e1b552ea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-407e369d-4e56-431f-b1f1-d83503c12c0f" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-407e369d-4e56-431f-b1f1-d83503c12c0f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-c9851ccd-751e-4e67-8ffa-c95e1b552ea6" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-c9851ccd-751e-4e67-8ffa-c95e1b552ea6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot c9851ccd-751e-4e67-8ffa-c95e1b552ea6 of volume 407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[447cda55-0d77-4fce-985b-efd00e2b93a7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:34 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 Sep 17 23:59:34 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:34 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6" returned: 0 in 0.358s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-407e369d-4e56-431f-b1f1-d83503c12c0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[42954231-54f0-4f29-b030-bd16c9c5f4e8]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:34 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:34 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f Sep 17 23:59:34 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:35 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f" returned: 0 in 0.389s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:35 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 Sep 17 23:59:35 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:35 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6" returned: 0 in 0.350s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:35 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6 Sep 17 23:59:35 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:35 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f.c9851ccd-751e-4e67-8ffa-c95e1b552ea6" returned: 0 in 0.244s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-c9851ccd-751e-4e67-8ffa-c95e1b552ea6" released by "_delete_snapshot" :: held 1.444s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-407e369d-4e56-431f-b1f1-d83503c12c0f" released by "delete_snapshot" :: held 1.466s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Created reservations ['97e95363-7a3d-4a90-bdbe-4f100a886fab', 'd1e8ef34-d34a-482b-80dd-3e1bb7ad7952', '41a43f2e-45f1-4494-a65b-2ba9893e9a0d', 'd44a8848-6518-4ede-834a-c30038601b5e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:35 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:59:35 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-9018a578-f6bc-45f3-8266-08856c952ce9 tempest-ProjectMemberTests-956936783 None] Lock "cinder-c9851ccd-751e-4e67-8ffa-c95e1b552ea6-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-407e369d-4e56-431f-b1f1-d83503c12c0f-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Lock "cinder-407e369d-4e56-431f-b1f1-d83503c12c0f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-407e369d-4e56-431f-b1f1-d83503c12c0f" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-407e369d-4e56-431f-b1f1-d83503c12c0f" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2ed3c8-7907-44e4-8781-17bb76165971]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:36 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f Sep 17 23:59:36 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:36 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f" returned: 0 in 0.403s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:36 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:37 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f Sep 17 23:59:37 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:37 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-407e369d-4e56-431f-b1f1-d83503c12c0f" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-407e369d-4e56-431f-b1f1-d83503c12c0f" released by "delete_volume" :: held 0.729s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Created reservations ['eae2d452-9f95-4f4b-ae89-bbb931c99209', '88764de6-3455-4bb1-87d7-1e6d9c444bc0', 'e6225ece-111c-4a54-80f5-145a01ddc3a1', 'bb11427f-bfc0-4146-9270-994f7e52de2e'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:37 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:37 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:37 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.271s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:37 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:59:37 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f78893a0-fde9-47b8-aa54-1fddfecb5af5 tempest-ProjectMemberTests-956936783 None] Lock "cinder-407e369d-4e56-431f-b1f1-d83503c12c0f-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (58827078-7b5e-464e-a9c4-457d3b35b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2202f1-8abe-449f-9eaf-9e24b089e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2202f1-8abe-449f-9eaf-9e24b089e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665729017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c165ce4-a94d-481b-81d7-512d5797cafb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:38Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c98e08-3e86-461d-8f30-8d4304e9abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c98e08-3e86-461d-8f30-8d4304e9abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64dae0c-fcbe-4d99-9db6-b2a20bead0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64dae0c-fcbe-4d99-9db6-b2a20bead0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c165ce4-a94d-481b-81d7-512d5797cafb', 'volume_name': 'volume-5c165ce4-a94d-481b-81d7-512d5797cafb', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475dcc55-0a86-4abc-86d2-44fbe067651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475dcc55-0a86-4abc-86d2-44fbe067651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0725ffa-ed8c-4feb-8052-e5d4a9714d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:38 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Volume 5c165ce4-a94d-481b-81d7-512d5797cafb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c165ce4-a94d-481b-81d7-512d5797cafb', 'volume_size': 1} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665729017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c165ce4-a94d-481b-81d7-512d5797cafb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b5fd09e98d43c6a1bc7684c8a36990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:38Z,use_quota=True,user_id='3bf1799b6d364db59af17fa54df7ab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Creating volume 5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:38 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:38 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb 1073741824 Sep 17 23:59:38 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:38 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb 1073741824" returned: 0 in 0.429s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:38 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb Sep 17 23:59:38 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:38 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb" returned: 0 in 0.265s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0725ffa-ed8c-4feb-8052-e5d4a9714d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c165ce4-a94d-481b-81d7-512d5797cafb', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b439e02f-1934-4b4b-a8e1-23a8f147f162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:38 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Volume volume-5c165ce4-a94d-481b-81d7-512d5797cafb (5c165ce4-a94d-481b-81d7-512d5797cafb): created successfully Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b439e02f-1934-4b4b-a8e1-23a8f147f162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:38 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Flow 'volume_create_manager' (58827078-7b5e-464e-a9c4-457d3b35b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:38 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e07443df-f000-4fd6-b894-72248cda1930 tempest-ProjectMemberTests-956936783 None] Created volume successfully. Sep 17 23:59:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:39 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Creating offline snapshot 4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f of volume 5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 23:59:39 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bc7399-9e8b-4cfa-adfc-c0608db1a287]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:39 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb Sep 17 23:59:39 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:39 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb" returned: 0 in 0.374s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:39 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f 1G {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:39 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f 1G Sep 17 23:59:39 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:40 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f 1G" returned: 0 in 0.445s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c165ce4-a94d-481b-81d7-512d5797cafb -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:40 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c165ce4-a94d-481b-81d7-512d5797cafb -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f Sep 17 23:59:40 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:40 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c165ce4-a94d-481b-81d7-512d5797cafb -F qcow2 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" returned: 0 in 0.296s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:40 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f is being set with open permissions: ugo+rw Sep 17 23:59:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:40 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f Sep 17 23:59:40 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:40 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" returned: 0 in 0.256s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:40 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:40 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.info Sep 17 23:59:40 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:41 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.info" returned: 0 in 0.277s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:41 devstack cinder-volume[85956]: WARNING cinder.volume.drivers.remotefs [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.info is being set with open permissions: ugo+rw Sep 17 23:59:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.info {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:41 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.info Sep 17 23:59:41 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:41 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.info" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:41 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:41 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-b3d2aa1d-bc8f-4441-896b-b01bb68789cb tempest-ProjectMemberTests-956936783 None] Create snapshot completed successfully Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:42 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:42 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:42 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.250s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_service.periodic_task [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] Running periodic task VolumeManager._thread_info {{(pid=85956) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread count: 28 {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-487990ca-e25a-485f-9ffa-971577c17d7d None None] thread info: [<_MainThread(MainThread, started 133095797637248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85956) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f-delete_snapshot" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Lock "cinder-4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-5c165ce4-a94d-481b-81d7-512d5797cafb" by "delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-5c165ce4-a94d-481b-81d7-512d5797cafb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" by "_delete_snapshot" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Deleting offline snapshot 4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f of volume 5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] snapshot_file for this snap is: volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f {{(pid=85956) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c5072-11da-4e5b-a520-aa47cab42aa4]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:42 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:42 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f Sep 17 23:59:42 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:43 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" returned: 0 in 0.386s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c165ce4-a94d-481b-81d7-512d5797cafb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85956) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacbf09b-ffd3-4a50-8578-e60b2c622b0a]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:43 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb Sep 17 23:59:43 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:43 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb" returned: 0 in 0.379s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:43 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f Sep 17 23:59:43 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:43 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" returned: 0 in 0.336s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:43 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:43 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f Sep 17 23:59:43 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:44 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb.4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" returned: 0 in 0.248s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f" released by "_delete_snapshot" :: held 1.470s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-5c165ce4-a94d-481b-81d7-512d5797cafb" released by "delete_snapshot" :: held 1.493s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Created reservations ['89aa9ce8-1690-43d7-ace0-686565bc78d6', 'c10e7830-1ae8-4c83-aa74-b32f971f8019', '0ae4fe14-6f08-4aa2-b032-a7f8df1d0b02', 'fb9fd634-0d75-427b-85a0-59722ac97707'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:44 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Delete snapshot completed successfully. Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-59771aaf-97b0-4e2a-ad26-d1d809eaa0d6 tempest-ProjectMemberTests-956936783 None] Lock "cinder-4dcafd3c-8b6d-4ad5-8b95-c171fc89ee9f-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-5c165ce4-a94d-481b-81d7-512d5797cafb-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Lock "cinder-5c165ce4-a94d-481b-81d7-512d5797cafb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Acquiring lock "cinder-quobyte-5c165ce4-a94d-481b-81d7-512d5797cafb" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-5c165ce4-a94d-481b-81d7-512d5797cafb" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db486a-20fa-4946-b841-fe5dfddaaab7]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:44 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:44 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb Sep 17 23:59:44 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:45 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb" returned: 0 in 0.397s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:45 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb Sep 17 23:59:45 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:45 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5c165ce4-a94d-481b-81d7-512d5797cafb" returned: 0 in 0.249s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Lock "cinder-quobyte-5c165ce4-a94d-481b-81d7-512d5797cafb" released by "delete_volume" :: held 0.723s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Created reservations ['2cea387f-f8ee-47b5-9e44-d25b5b1ab752', 'c47010a2-04ca-4e3c-b5f6-9373f3fed01b', '07940545-1b92-4c60-bf2c-162648df860c', '4b1e850f-14d2-4440-a071-b3316701a892'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:45 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 17 23:59:45 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:45 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.250s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 23:59:45 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Deleted volume successfully. Sep 17 23:59:45 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-f20ba40b-80e2-4879-aa88-8844c99d3bbb tempest-ProjectMemberTests-956936783 None] Lock "cinder-5c165ce4-a94d-481b-81d7-512d5797cafb-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 23:59:55 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=42,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=3 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:59:55 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=34,cinder:UPDATE=61,cinder:INSERT=19,cinder:DELETE=4 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (4abd22f4-9c80-4419-ae13-0b28d16a666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9541c0d-83d0-4014-9b55-db64e5450583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9541c0d-83d0-4014-9b55-db64e5450583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157123928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1ff54e-33a3-4e26-95e7-c58fcd8a508e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:58Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67026c77-699a-4030-ba2f-f2876ca482c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67026c77-699a-4030-ba2f-f2876ca482c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999bded9-3958-4d09-8ff4-5d2b4a866b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999bded9-3958-4d09-8ff4-5d2b4a866b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1ff54e-33a3-4e26-95e7-c58fcd8a508e', 'volume_name': 'volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1e5ffe-9f76-40d1-8641-664f57534fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1e5ffe-9f76-40d1-8641-664f57534fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0068ba1-4cc1-4283-8ae0-a2973e448387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:58 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Volume 5b1ff54e-33a3-4e26-95e7-c58fcd8a508e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e', 'volume_size': 1} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T21:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157123928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1ff54e-33a3-4e26-95e7-c58fcd8a508e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T21:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T21:59:58Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Creating volume 5b1ff54e-33a3-4e26-95e7-c58fcd8a508e {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 23:59:58 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:58 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e 1073741824 Sep 17 23:59:58 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:58 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e 1073741824" returned: 0 in 0.397s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:58 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e Sep 17 23:59:58 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:58 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e" returned: 0 in 0.248s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0068ba1-4cc1-4283-8ae0-a2973e448387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e100ee-62b9-43af-98fb-905866476348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 23:59:58 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Volume volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e (5b1ff54e-33a3-4e26-95e7-c58fcd8a508e): created successfully Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e100ee-62b9-43af-98fb-905866476348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 23:59:58 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (4abd22f4-9c80-4419-ae13-0b28d16a666c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 23:59:58 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-64cba5c0-6eda-4ab9-8997-e14551b7cec2 tempest-ProjectReaderTests-1324457046 None] Created volume successfully. Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Lock "cinder-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-quobyte-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e" acquired by "delete_volume" :: waited 0.013s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7ae831-b2a6-49e9-8dfb-5bb700c50aed]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:59 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e Sep 17 23:59:59 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:59 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e" returned: 0 in 0.344s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 23:59:59 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e Sep 17 23:59:59 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 23:59:59 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 17 23:59:59 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e" returned: 0 in 0.251s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e" released by "delete_volume" :: held 0.637s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Created reservations ['51962834-2bde-48f3-9316-4e5010bc5e12', '90f06d17-5bd2-4179-b057-cdaae01fd038', '5db7640f-a61a-4544-9fb0-c14efc2c9abe', '85241629-db52-41d5-9235-eba288ae44a3'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:00 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 18 00:00:00 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:00 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.245s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:00:00 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Deleted volume successfully. Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-ed6e4355-2cad-40c3-b35b-0479e283141a tempest-ProjectReaderTests-1324457046 None] Lock "cinder-5b1ff54e-33a3-4e26-95e7-c58fcd8a508e-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (548bb4cf-a02a-412d-83ac-662c51f0e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977670b8-897b-403b-870c-31e8719addb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977670b8-897b-403b-870c-31e8719addb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957893187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307594ea-6100-417c-8340-b4cc449b7b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:00:01Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98251f04-7176-4468-a710-18269024d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98251f04-7176-4468-a710-18269024d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4055f079-d0f9-4229-8a44-92f1fbfa9605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4055f079-d0f9-4229-8a44-92f1fbfa9605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307594ea-6100-417c-8340-b4cc449b7b33', 'volume_name': 'volume-307594ea-6100-417c-8340-b4cc449b7b33', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b6664-6d12-46a4-967a-530c4462edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b6664-6d12-46a4-967a-530c4462edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3b7d26-62fe-4af0-9086-fd67e8fbee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:00 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Volume 307594ea-6100-417c-8340-b4cc449b7b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307594ea-6100-417c-8340-b4cc449b7b33', 'volume_size': 1} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957893187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307594ea-6100-417c-8340-b4cc449b7b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:00:01Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Creating volume 307594ea-6100-417c-8340-b4cc449b7b33 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:00:00 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 18 00:00:00 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:00 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 1073741824 Sep 18 00:00:00 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:01 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 1073741824" returned: 0 in 0.400s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:01 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 Sep 18 00:00:01 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:01 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33" returned: 0 in 0.239s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3b7d26-62fe-4af0-9086-fd67e8fbee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307594ea-6100-417c-8340-b4cc449b7b33', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a607a8-c24e-41e4-b7e9-5992a0e443a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:01 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Volume volume-307594ea-6100-417c-8340-b4cc449b7b33 (307594ea-6100-417c-8340-b4cc449b7b33): created successfully Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a607a8-c24e-41e4-b7e9-5992a0e443a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (548bb4cf-a02a-412d-83ac-662c51f0e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:00:01 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-855ffade-e434-4f84-9e93-bb3caefaa092 tempest-ProjectReaderTests-1324457046 None] Created volume successfully. Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-307594ea-6100-417c-8340-b4cc449b7b33-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Lock "cinder-307594ea-6100-417c-8340-b4cc449b7b33-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-quobyte-307594ea-6100-417c-8340-b4cc449b7b33" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:00:01 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-307594ea-6100-417c-8340-b4cc449b7b33" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40150c-d865-4b93-a43f-f3dcd91fa6cc]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:02 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 Sep 18 00:00:02 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:02 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33" returned: 0 in 0.363s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:02 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33 Sep 18 00:00:02 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:02 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-307594ea-6100-417c-8340-b4cc449b7b33" returned: 0 in 0.237s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-307594ea-6100-417c-8340-b4cc449b7b33" released by "delete_volume" :: held 0.644s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Created reservations ['f4567f2f-a60b-4aa9-9278-0e5831b137c6', '83452221-91ce-4209-b3a6-815b2bdd3aff', '950e143e-962d-4a3a-8448-d89e20fba1e8', '8fc41e9e-495d-4532-ab5d-b6f5b6d71bd2'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:02 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 18 00:00:02 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:02 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.242s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:02 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:00:02 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Deleted volume successfully. Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-e983a6e7-8ac1-48a4-b751-193cbf8d7aee tempest-ProjectReaderTests-1324457046 None] Lock "cinder-307594ea-6100-417c-8340-b4cc449b7b33-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (43a0f3da-6420-4874-89b9-1f020ad9ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4655bf43-f553-47a4-9f05-85298fc55dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4655bf43-f553-47a4-9f05-85298fc55dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594939916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daaa9fa-6f19-43b6-8068-6d84521cd9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:00:03Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1bfd00-056f-45c0-9f75-a696dde1f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1bfd00-056f-45c0-9f75-a696dde1f656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a243fcf-c3e8-494c-a1b3-0271a56439f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a243fcf-c3e8-494c-a1b3-0271a56439f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1daaa9fa-6f19-43b6-8068-6d84521cd9e1', 'volume_name': 'volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d5d111-45c0-4f09-a398-31d42bf19630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d5d111-45c0-4f09-a398-31d42bf19630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71aeb36c-ada8-4625-bfde-33901686f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:03 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Volume 1daaa9fa-6f19-43b6-8068-6d84521cd9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1', 'volume_size': 1} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594939916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daaa9fa-6f19-43b6-8068-6d84521cd9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:00:03Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Creating volume 1daaa9fa-6f19-43b6-8068-6d84521cd9e1 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:00:03 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 18 00:00:03 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:03 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 1073741824 Sep 18 00:00:03 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:04 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 1073741824" returned: 0 in 0.435s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:04 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 Sep 18 00:00:04 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:04 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1" returned: 0 in 0.239s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71aeb36c-ada8-4625-bfde-33901686f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7a78a5-0e98-4c4d-a61c-12fdefc6f964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:04 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Volume volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 (1daaa9fa-6f19-43b6-8068-6d84521cd9e1): created successfully Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7a78a5-0e98-4c4d-a61c-12fdefc6f964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (43a0f3da-6420-4874-89b9-1f020ad9ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:00:04 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-4f0e50de-7830-4bb1-a782-d61151ccb796 tempest-ProjectReaderTests-1324457046 None] Created volume successfully. Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-1daaa9fa-6f19-43b6-8068-6d84521cd9e1-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-1daaa9fa-6f19-43b6-8068-6d84521cd9e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-quobyte-1daaa9fa-6f19-43b6-8068-6d84521cd9e1" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-1daaa9fa-6f19-43b6-8068-6d84521cd9e1" acquired by "delete_volume" :: waited 0.015s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a20913-e3a3-4e76-8e82-11124c357205]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:00:04 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:04 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 Sep 18 00:00:04 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:05 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1" returned: 0 in 0.362s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:05 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1 Sep 18 00:00:05 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:05 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-1daaa9fa-6f19-43b6-8068-6d84521cd9e1" returned: 0 in 0.240s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-1daaa9fa-6f19-43b6-8068-6d84521cd9e1" released by "delete_volume" :: held 0.642s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Created reservations ['e52991ac-2ddf-4ff5-8532-a0ea0c1cc6a7', '6c866b7d-ca32-4186-bd63-390647f508e9', '2eeacd11-e3be-4b8b-9d5b-ece43d5a7c73', 'f2583bc2-0a66-4602-afc7-5b9b64170bd9'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:05 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 18 00:00:05 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:05 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.239s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:00:05 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Deleted volume successfully. Sep 18 00:00:05 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-666c276e-47cb-44c3-b64b-7475ee355c91 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-1daaa9fa-6f19-43b6-8068-6d84521cd9e1-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85956) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (c26b0c8b-6d44-42e1-b6cf-a5870eba7a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25663b5-7dab-44ce-b0f1-ea3f97f50964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25663b5-7dab-44ce-b0f1-ea3f97f50964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650562169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5448e9d2-3c74-4b94-873a-2ea13447f8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:00:06Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81097358-8281-4a95-8913-a31b67e2e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81097358-8281-4a95-8913-a31b67e2e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d44ef2a-076a-4b75-ab85-f364f749b1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d44ef2a-076a-4b75-ab85-f364f749b1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5448e9d2-3c74-4b94-873a-2ea13447f8d5', 'volume_name': 'volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea4165c-fda8-4ac9-abba-03bc66e144b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea4165c-fda8-4ac9-abba-03bc66e144b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36f4a8f-7a32-4c77-89cc-d54f3e9c002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:06 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Volume 5448e9d2-3c74-4b94-873a-2ea13447f8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5', 'volume_size': 1} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650562169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5448e9d2-3c74-4b94-873a-2ea13447f8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b806e58281945439ab125faa495338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:00:06Z,use_quota=True,user_id='66186f51da76436cbb3731c74dd6fa7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2cb623-b105-4724-920c-fb40660cccbc),volume_type_id=ca2cb623-b105-4724-920c-fb40660cccbc)}" {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.remotefs [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Creating volume 5448e9d2-3c74-4b94-873a-2ea13447f8d5 {{(pid=85956) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Selected osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 as target Quobyte volume. {{(pid=85956) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:00:06 devstack cinder-volume[85956]: INFO cinder.volume.drivers.remotefs [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] casted to osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43 Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 1073741824 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:06 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 1073741824 Sep 18 00:00:06 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:06 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 1073741824" returned: 0 in 0.405s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:06 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 Sep 18 00:00:06 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:06 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5" returned: 0 in 0.242s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'} {{(pid=85956) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36f4a8f-7a32-4c77-89cc-d54f3e9c002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5', 'volume_size': 1}' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe568abe-e1c2-40b5-961a-b5857c59c23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:00:06 devstack cinder-volume[85956]: INFO cinder.volume.flows.manager.create_volume [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Volume volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 (5448e9d2-3c74-4b94-873a-2ea13447f8d5): created successfully Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe568abe-e1c2-40b5-961a-b5857c59c23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85956) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:00:06 devstack cinder-volume[85956]: DEBUG cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Flow 'volume_create_manager' (c26b0c8b-6d44-42e1-b6cf-a5870eba7a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85956) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:00:06 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-dd5ed5e0-8079-491a-ae51-4d534e3c86b2 tempest-ProjectReaderTests-1324457046 None] Created volume successfully. Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-5448e9d2-3c74-4b94-873a-2ea13447f8d5-delete_volume" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-5448e9d2-3c74-4b94-873a-2ea13447f8d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "cinder-quobyte-5448e9d2-3c74-4b94-873a-2ea13447f8d5" by "delete_volume" {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-5448e9d2-3c74-4b94-873a-2ea13447f8d5" acquired by "delete_volume" :: waited 0.016s {{(pid=85956) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff8ae3-15fe-4de5-9898-3fdf60d729e2]: (4, 'qcow2') {{(pid=86697) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:07 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 Sep 18 00:00:07 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:07 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5" returned: 0 in 0.353s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:07 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5 Sep 18 00:00:07 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:07 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6/volume-5448e9d2-3c74-4b94-873a-2ea13447f8d5" returned: 0 in 0.241s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-quobyte-5448e9d2-3c74-4b94-873a-2ea13447f8d5" released by "delete_volume" :: held 0.635s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.quota [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Created reservations ['79249333-de91-45ac-b250-6f79303166bb', '48f235d3-83ea-4423-b06c-f3c2d2b08772', 'ac3ed8ce-5699-4d94-9618-60a2f795058f', '8957e873-0917-448e-b37d-4ddc3ba4caf5'] {{(pid=85956) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43': None} {{(pid=85956) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG cinder.volume.drivers.quobyte [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4c27426-2a2f-4560-8188-38c9fff14d43'] {{(pid=85956) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.lockutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85956) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:00:07 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:00:07 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6 Sep 18 00:00:07 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:00:08 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 18 00:00:08 devstack cinder-volume[85956]: DEBUG oslo_concurrency.processutils [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099b8dc6d108e32edb1af7ef166125e6" returned: 0 in 0.238s {{(pid=85956) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:00:08 devstack cinder-volume[85956]: DEBUG cinder.manager [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Notifying Schedulers of capabilities ... {{(pid=85956) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:00:08 devstack cinder-volume[85956]: INFO cinder.volume.manager [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Deleted volume successfully. Sep 18 00:00:08 devstack cinder-volume[85956]: DEBUG cinder.coordination [None req-8e342d41-e214-4f7f-8057-995a3a783732 tempest-ProjectReaderTests-1324457046 None] Lock "cinder-5448e9d2-3c74-4b94-873a-2ea13447f8d5-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=85956) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:00:18 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:UPDATE=38,cinder:SELECT=30,cinder:DELETE=6,cinder:INSERT=10 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:00:22 devstack cinder-volume[85956]: DEBUG dbcounter [-] [85956] Writing DB stats cinder:SELECT=27,cinder:UPDATE=51,cinder:INSERT=10,cinder:DELETE=2 {{(pid=85956) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}